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Over a long period of time, hu- 
has 
evolved from gestural origins with- 


man-human communication 
out much of a structure to a natural 
language that enables successful and 
complex conversations. Despite en- 
gaging scholars for an undetermined 
time, communication has been thor- 
oughly studied since the zoth centu- 
ry. What has been noted by various 
philosophers as well as linguists ever 
since, is the importance of the prag- 
matic layer. Similarly, different re- 
searchers have recently proposed the 
adoption of the pragmatic layer to the 
Web and human-computer interac- 
tion. As that sort of communication is 
expected to evolve and become more 
conversational, as well as allow ne- 
gotiations, it is evident that conver- 


sational interfaces, such as chatbots, 
play an important role in this act. 


Chatbots are not the fruits of recent 
developments as the first improve- 
ments date back to the 1960s. Yet, 
modern advancements in Artificial 
Intelligence and Natural Language 
Processing, as well as the popularity 
of Instant Messaging platforms, have 
contributed to the recent rise of chat- 
bots. For example, it has been stat- 
ed that 25% of customer service and 
support operations will run through 
chatbots or other virtual customer 
assistants already in 2020. Despite 
these optimistic numbers and the 
extreme endorse in 2016, the hype of 
the chatbots has started to fade and 
communication with them is often 


seen as failing. However, it is believed 
thatthe era of chatbots has simply not 
vet arrived. Thus, designers should 
find solutions to make the interaction 
more meaningful and support the 
success of this future communication 
tool, before it is too late. 


The current study aimed to look be- 
vond technical deficits and focus on 
investigating the users’ perceptions 
about the experience with a chatbot. 
Especially so in terms of pragmatic 
aspects of communication in order 
to understand how the shortcom- 
ings influence the overall experience. 
Therefore, it was critical to: first, un- 
derstand human-human communi- 
cation; second, study the benefits as 
well as drawbacks of existing chat- 
bots. Followingly, 15 participants were 
recruited for a qualitative research, 
with the aim to gather thoughts and 
impressions of the experience. The 
results of the thematic analysis point- 
ed at shortcomings in five different 
pragmatic topics. As a final step, the 
current work first offers suggestions 
to better some aspects and therefore 
the overall experience of chatbots. 
Second, coming from the results, 
the research expresses a rather dis- 
couraging opinion about the future 
of chatbots and questions if they will 
ever be good enough. 


La comunicazione interpersonale 
si è evoluta nel tempo passando 
progressivamente da gestualità 
poco strutturate a un linguaggio 
naturale che permette lo svolgersi di 
conversazioni articolate. Nonostante 
abbia a lungo affascinato gli studiosi, 
la comunicazione ha iniziato ad essere 
oggetto di analisi approfondite solo a 
partire dal ventesimo secolo. Ciò che 
vari filosofi e linguisti hanno notato 
da allora è l’importanza dello strato 
pragmatico. Analogamente, diversi 
recentemente 
proposto dello 


pragmatico al Web e all’interazione 


ricercatori hanno 


l'adozione strato 


uomo-macchina. Essendo questo 
tipo di comunicazione destinato ad 
evolversi e a diventare colloquiale, 


oltre a permettere interazioni sempre 


più avanzate, è evidente come 
interfacce come i chatbot abbiano un 


ruolo importante in questo ambito. 


il frutto di 
recenti sviluppi: i primi esemplari 


I chatbot non sono 


risalgono agli anni sessanta. Tuttavia, 
l’evoluzione dell’Intelligenza 
Artificiale e dell’elaborazione del 
(NLP), 


alla popolarità delle piattaforme di 


linguaggio naturale giunta 


messaggistica istantanea, hanno 
contributo alla crescita dei moderni 
chatbot. Per esempio, si stima che 
già nel 2020 il 25% delle attività di 
servizio e supporto al cliente saranno 
effettuate da chatbot o altri assistenti 
virtuali. Nonostante l’ottimismo di 
questi numeri e l’eccitazione del 


2016, l’hype attorno ai chatbot sta 


iniziando a svanire e il loro utilizzo 
nella comunicazione sta iniziando ad 
essere percepito come un fallimento. 
Tuttavia, molti sostengono che l’era 
dei chatbot non sia semplicemente 
ancora arrivata. È quindi compito 
del designer trovare una soluzione 
che renda questa interazione più 
significativa e di supportare il 
successo di questo nuovo strumento 
di comunicazione, prima che sia 


troppo tardi. 

L'obiettivo di questo studio era 
di andare oltre le limitazioni 
tecnologiche e di concentrarsi 


sull'analisi della percezione che gli 
utenti hanno della propria esperienza 
con un chatbot. In particolare, 
soffermandosi sugli aspetti pragmatici 
della comunicazione, in modo da 
comprendere come questi limiti 
influenzino l’esperienza generale. 
Pertanto, è stato fondamentale: primo, 
comprendere la comunicazione 
uomo-uomo; secondo, studiare tanto 
i vantaggi come gli svantaggi dei 
chatbot moderni. Successivamente, 
15 partecipanti sono stati selezionati 
per uno studio qualitativo, con 
l’obiettivo di raccogliere opinioni e 
impressioni su questa esperienza. 
I risultati di questa analisi tematica 
hanno evidenziato limiti in cinque 


differenti categorie di pragmatica. 


A conclusione, questo studio offre 
suggerimenti per migliorare alcuni 
aspetti della globale esperienza con 
i chatbot. Inoltre, come evinto dai 
risultati raccolti, la ricerca esprime 
un parere decisamente scoraggiante 
riguardo al futuro dei chatbot e pone 
in dubbio la loro efficacia. 
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. Intro_ 
- duction 


There are numerous science fic- 
tion movies, books and comics about 
aliens landing on planet Earth and 
taking over the world. Yet, it is not 
usually mentioned that it has actually 
already happened. Twice, to be more 
clear. 


To explain the rationale - humans 
themselves were once the unknown 
aliens. The early ancestors “land- 
ed” on Earth, not knowing anything 
about life and circumstances here, yet 
they vigorously started to take over 
the world. It can be assumed that at 
first they had problems understand- 
ing each other and thus, after a while, 
started to communicate with gestures 
(Tomasello 2008). Since language it- 
self leaves no traces, it is hard to de- 
fine when exactly did humans start to 
use regular language with structure 
and order. However, being one of the 
most important means that allowed 
humankind to evolve from mysteri- 
ous aliens into native humans, com- 
munication has been studied for elu- 
sive time and countless researchers 
have been captured since the ancient 
days. More thoroughly, though, has 
communication been studied from 
the 2oth century - first, various defi- 
nitions and variables tried to compre- 
hend the complex nature of commu- 
nication; different models discussed 


the process of communication; and 
diverse philosophers went even deep- 
er into the entity layers. Consequent- 
ly, next to syntactics and semantics, 
pragmatics was defined as one of 
the three groundsels of communi- 
cation. It defines the way people use 
language in everyday communication 
and how they understand what is ac- 
tually meant by what has been said 
- how the language is used in com- 
munication and understood by the 
communicators (Leech 1983). These 
days, people manage to have mean- 
ingful, yet complex discourses intra- 
culturally, as well as interculturally 
- over millions of years, humankind 
has become along way from being the 
bizarre, strange aliens. 


As mentioned, aliens landing on plan- 
et Earth has happened twice and the 
second time was not that long ago. 
Namely, in the 1990s, alien breed 
called computers started to invade 
all of the households and ever since, 
it has been one great mission to make 
people and computers understand 
each other. First, it was managed 
through Command Line Interfaces 
(CLIs) but as they were complex to 
handle and caused cognitive over- 
load for casual users, Graphical User 
Interfaces (GUIs) were born. As the 
century changed, so did the interac- 
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tion - it moved from personal desk- 
tops to World Wide Web, allowing 
communication with other human 
beings through Computer Mediated 
Communication (CMC) and a bit lat- 
er to smartphones, allowing access 
to information every time and every- 
where. Thus, the amount of informa- 
tion has grown immense and finding 
exactly what one needs has become a 
complex activity. In order to simplify 
that action, an interest for Conversa- 
tional User Interfaces (CUIs) and the 
desire to facilitate Human-Machine 
Communication (HMC) in natural 
language, is ever-growing. Similar- 
ly to human-human communication, 
adoption of pragmatic layer to the 
Web has been suggested by many 
researchers recently. It would allow 
shared 
meanings (de Moor, Schoop et al. 


agreements and modified 


2006), negotiation and human collab- 
oration. Therefore, it is apparent that 
the future of Human-Computer In- 
teraction (HCI) will be conversational 
and CUIs, such as chatbots, will play 
an important role in this act. 


To make computers less alien-like 
and converse with them like humans 
do among one another, several schol- 
ars have been discovering various 
ways. The first successful attempts 
trace back to the 1960s when a chat- 


bot called ELIZA was born in MIT 
labs and enabled humans to text with 
computer in natural language. 


Despite recent advancements in Ar- 
tificial Intelligence (AI) and Natural 
Language Processing (NLP), almost 
60 years later the chatbots still fail to 
deliver meaningful and helpful con- 
versations. However, due to the in- 
formation overload, mentioned earli- 
er, as well as the popularity of Instant 
Messaging (IM) applications, chatbots 
have become desired tools and it is 
believed that their time has not yet 
arrived (Graham 2017). 


Cathy Pearl, Google’s Head of Con- 
versation Design Outreach, suggest- 
ed: “/.../ Al is this buzz-word and ev- 
erybody thinks you have to have AI 
to have a successful conversational 
system, which |...] is certainly some- 
thing to strive for [...] But I think some 
people forget that you can have a very 
effective, important conversational 
systems without a lot of AI.” (Crowley 
2019). 


Similarly, the current work empha- 
sizes the importance of finding ways 
to design chatbots in a better way 
while looking beyond technological 
shortcomings. 


Prior researchers (Jain et al. 2018) 
have worked on user interface ele- 
ments to better convey the context to 
the communicators. Also, Valério et 
al. (2017) analyzed and evaluated the 
different techniques that chatbots ap- 
ply to inform the user about its com- 
petencies. The academic community 
(for example Mou, Xu 2017; Thies et al. 
2017; Go, Sundar 2019) has extensively 
explored human-like aspects, the an- 
thropomorphism of chatbots. These 
studies, similarly to the current one, 
base the research on the fact that hu- 
mans take computers as social actors 
(Reeves, Nass 1996). 


What is more, Steven Pinker (2011), a 
well-known cognitive psychologist, 
linguist, and professor at Harvard 
University, brought the reason why 
people understand language much 
better than computers - it is the third 
interface standing between language 
and the mind, the pragmatics. 


Given the above, the current work 
finds it crucial to apply the study of 
human-human communication to 
Human-Machine Communication, 
and even more so, the pragmatics in 
detail. Of course, researchers have 
used pragmatics before, for example 
En and Lan (2012) applied Politeness 


maxims to design the dialogue with a 


robot, and similarly, Hall (2018) sug- 
gested to use Gricean maxims for in- 
teracting with chatbots. However, to 
the knowledge of the current work’s 
author, thus far, no other study di- 
rectly investigated the pragmatic as- 
pects of human-chatbot communica- 
tion to understand how they influence 
the overall user experience. There- 
fore, the study poses the research 
question: 


How do users perceive the 
pragmatic shortcomings in 
communication with chatbots? 


The current thesis aims to answer the 
research question and thus give a con- 
tribution to improving the user expe- 
rience in the field of chatbots. Hence, 
after the main question is answered, 
another two opposing challenges, that 
zoom out from the narrow scope and 
see the study in a broader perspective, 
will be investigated. Therefore, it is 
believed that users, designers as well 
as companies who wish to implement 
a chatbot, benefit from the research. 
In addition, the work can be seen as a 
framework to facilitate similar stud- 
ies that combine thorough theoretical 
background with innovative fields, 
and analyse the results in light of the- 
matic analysis method. 
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“.. AI is this buzz-word 
and everybody thinks 
you have to have AI 
to have a successful 
conversational system, 
which ... is certainly 
something to strive 
for ... But I think some 
people forget that 
you can have a very 
effective, important 
conversational systems 
without a lot of AI.” 


CATHY PEARL, GOOGLE'S HEAD OF CONVERSATION DESIGN OUTREACH 


The thesis consists of 7 chapters. 


The 1st chapter aims to give a brief 
introduction to the research topic, 
address the relevance of the field at 
the given moment and bring out the 
problem to be explored. Also, a short 
overview of the expected contribution 
is given. 


The 2nd chapter will go deep with hu- 
man-human communication - what 
is it, how people communicate and 
why do they succeed in communi- 
cation. Hence, the description starts 
from the surface of the problem while 
attempting to define communication 
and moves towards the core while 
seeking to understand why people 
manage to communicate successfully. 
Therefore, several pragmatic theories 
are illustrated to facilitate the latter 
study. 


The 3rd chapter will focus on hu- 
man-computer communication - how 
has it evolved and where it is now. 
The relevance of the field is described 
in a more thorough way. Therefore, 
conversational interfaces, especially 
chatbots and the corresponding state 
of the artwill be discussed. 


The 4th chapter will describe the 
methodology of the current work. 


Thus, stating the question that need- 
ed to be answered, how was the qual- 
itative research conducted, who were 
the participants of the study, which 
tools were used to help facilitate the 
in-depth interviews, and how was the 
final data analysed. 


The 5th chapter will give a thorough 
overview of the results. The final 
themes of the analysis will be de- 
scribed in detail. 


The 6th chapter will discuss the re- 
sults of the study. The interpretations 
are given, as well as implications are 
discussed. After addressing the re- 
search question, another two ques- 
tions are answered to give an under- 
standing how the research fits into 
the state of the art. Finally, limitations 
of the work are addressed. 


The 7th chapter will conclude the 
study and present final ideas about 
the overall research. 
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Evolution of human 
communication _ 

: from primal 
vestres IO 
meamimgful 
diseomese 


In order to understand human com- 
munication thoroughly, it is needed 
to dive deep into history. What makes 
the task complex, however, is the 
matter that there is no proven theory 
of how communication originated. 


Ithas been stated that language start- 
ed to evolve in the Stone Age, around 
1.75 million years ago (Uomini, Meyer 
2013). What is more, Tomasello (2008) 
discusses the hypothesis that human 
communication had a gestural origin 
with cooperative intentions. Whereas 
some researchers (Hauser, Yang et al. 
2014) have claimed that the wealth of 
thoughts is accompanied by a lack of 
proof, with no explana- 


THE LAST 
200 000 YEARS 


tion of how and why our 
linguistic computations 
and representations 
have developed. 
Additionally, | archae- 


explorations 


THE LAST 
A 6000 YEARS 
ological 
continue the discussion 
with 
ories. The oldest cave 


alternative the- 


paintings found, were 
THE LAST 
180 YEARS 


drawn as early as 38800 
B.C., and around three 
millenniums later these 
paintings started to tell 
a story - this has been 


seen as an evidence of 


spoken language (Mark 2011). Itis hard 
to tell when exactly communication 
took off in the form of speaking since 
the speech itself leaves no footprints. 


However, seen as the first revolu- 
tion of human communication, writ- 
ten language emerged ca 3500-3000 
B.C. in Sumer, southern Mesopota- 
mia (Mark 2011). Figure 2.1 illustrates 
that writing did not appear for a long 
time in the history of communication. 
And at first, the ability to read as well 
as write was reserved for elite, but 
with the emergence of printing and 
mass distribution, these competen- 
cies crossed the borders and social 
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classes. As an additional result, great 
technological developments start- 
ed to loom: photography, radio, TV, 
computers, the Internet, and lastly, 


the mobile web (Hall 2018). 


These days, all of the everyday activi- 
ties go side by side with communica- 
tion. It is an innate feature of human 
beings, and they do not pay much at- 
tention to it. As a result, the impor- 
tance, as well as the complexity of 
communication is often overlooked. 
But untangling and understanding it 
completely is a hard task. 


WHAT IS 
COMMUNICATION? 


As seen, communication has been 
around and studied for an unde- 
termined time. But only in the 2oth 
century, it came to the spotlight and 
scholars started to research it as a 
substantial field (Littlejohn, 
2010). Also, they started to define 


Foss 


what communication actually is, yet, 
as it turns out, this is another com- 
plex task. 


Fiske (1990) affirmed the difficulty 
and pointed out that everything can 


be put under the communication 
umbrella - from television to literary 
criticism, from hairstyle to art, etc. He 
saw this as one of the problems why 
it is so hard to define communication: 
“[...] can we properly apply the term 
‘a subject of study’ to something as 
diverse and multi-faceted as human 
communication actually is?” (p. 1). 


In efforts to define communication, 
three points for the conceptual divi- 
sion were identified by Frank Dance 
(1970). First, the level of observation. 
Meaning that the definition can be 
neither too general, nor too restric- 
tive. As the second level, he brought 
out intentionality. Some definitions 
count only these messages that are 
sent and received purposefully, oth- 
ers do not include that limitation. 
Littlejohn and Foss (2010) brought 
an example where the definition of 
communication includes intention: 
“Those situations in which a source 
transmits a message to a receiver with 
conscious intent to affect the latter’s 
behaviors.” To illustrate the distinc- 
tion, a definition that does not re- 
quire intent: “Human communication 
has occurred when a human being re- 
sponds to a symbol.” The third level is 
the normative judgment. Some defi- 
nitions define whether the commu- 
nication was successful, effective, or 


accurate - the thought was changed 
successfully; others do not set such 
bars. Following is an example with 
the normative judgment: “Communi- 
cation is the verbal interchange of a 
thought or idea”. Whereas the defini- 
tion “the transmission of information” 
does not contain the level - informa- 
tion was sent, but it is not known if it 
was received. 


West and Turner (2010), on the other 
hand, first propose a general defi- 
nition: “Communication is a social 
process in which individuals employ 
symbols to establish and interpret 
meaning in their environment.” Com- 
ing from that, they suggest a frame- 
work for defining communication. 
They bring out five relevant key terms 
- social, process, symbol, meaning 
and environment. As social they note 
that people and interactions are ap- 
parent in the course of communica- 
tion. The second term, process, sug- 
gests that communication is dynamic 
and on-going, continually changing. 
Symbol is a label or representation of 
something. Meaning is what the com- 
municators draw out from the mes- 
sage. And finally, environment is the 
situation or context of the communi- 
cation. 


Clevenger Jr (1991) found that the 


problem to define communication for 
scholarly or scientific purposes roots 
from the fact that the verb “to com- 
municate” is well defined in the gen- 
eral dictionary and therefore is not 
easy to define for scholarly purpos- 
es. What is more, it is also one of the 
most elaborated terms of the English 
language. About 40 years ago, Frank 
Dance found more than 120 defini- 
tions, and scholars have suggested 
many more since (Griffin 2011). Cam- 
bridge Dictionary (2019) defines “com- 
munication” as: “the act of communi- 
cating with people” and “a message or 
a letter” - both being very broad and 
even including the word ‘communi- 
cating’ itself. Merriam-Webster Dic- 
tionary (2019) gives six different defi- 
nitions for “communication”, one of 
them perhaps the most accurate for 
the present work - not too broad, nei- 
ther too narrow: “a process by which 
information is exchanged between in- 
dividuals through a common system of 
symbols, signs, or behavior”. The defi- 
nition is not limiting communication 
as only face-to-face and it emphasiz- 
es the importance of a common sys- 
tem, including behavior. Whereas it 
is assumed that the term individuals 
does not imply to human beings only. 


Another fact worth noting, empha- 
sized by Littlejohn and Foss (2010), 
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is that communication differs within 
various cultures. As mentioned be- 
fore, scholars started to study com- 
munication in detail in the zoth cen- 
tury. The field attracted researchers 
all over the world: in the States as well 
as in Europe, Asia, and Africa. That 
being said, it is clear that they are 
not only culturally very different, but 
the history of communication theory 
differs as well. At first, the States fol- 
lowed rather quantitative methods, 
whereas Europe was influenced by 
Marxist perspectives and critical/cul- 
tural qualitative methods. Over time, 
both of them started to use mixed 
approaches, thus scholars started to 
disparate non-Western and Western 
communication theory. Although, 
being very different: for example, 
non-Western theories focus on unity 
and wholeness, whereas Western the- 
ory centers the person and individu- 
alism. Yet, it cannot be forgotten that 
there are also similarities between 
different cultures and more impor- 
tantly - not all people are the same 
within one culture, not even in one 
community (West, Turner 2010). Com- 
munication is not “one-size-fits-all”, it 
is such a complex and broad field and 
cannot be scaled down on any single 
model - done so, it will offer a limited 
view of communication that ignores 
nuances. “/.../ Our goal cannot and 


should not be to seek a standard model 
that applies universally to any com- 
(Littlejohn, 


munication situation.” 


Foss 2010, p. 8). 


There are diverse theories about 
whether or not it is possible to clearly 
define what communication is, as well 
as how to do it. But what is seen as an 
important factor by numerous schol- 
ars (Fiske 1990; Littlejohn, Foss 2010; 
West, Turner 2010; Griffin 2011), is that 
the definition needs to help the re- 
searcher in continuing with the work, 
guiding the research and answering 
the questions relevant for one’s study. 


HOW DO PEOPLE 
COMMUNICATE? 


It is well-known and apparent to ev- 
eryone that communication is a cru- 
cial and highly valuable part of ev- 
eryday life, not only to speak one’s 
thoughts but to work against loneli- 
ness, stay healthy, feel loved and be 
part of the community - to be fully 
human (Hargie, Dickson 2004). Yet, 
as noted, this obvious aspect of the 
commonplace is extremely difficult to 
explain within one sentence. There- 
fore, a more detailed look is needed 
for understanding how people com- 


municate. 


USING VERBAL AND NON- 
VERBAL CUES 


The most apparent way of commu- 
nicating is through the use of words, 
known as verbal communication. To 
be more precise, verbal communica- 
tion is seen as an expression of in- 
formation via language that consists 
of words and grammar (The Business 
Communication 2013). It can either 
occur face-to-face or be mediated via 
TV, phone, computer or other media. 
Therefore, also writing is introduced 
as verbal communication. 


Non-verbal, on the other hand, is often 
overlooked and seen as a secondary 
form of communication since it does 
not include any words. Although, as 
discussed, thousands of years ago the 
early humans first started communi- 
cating through non-verbal behavior. 
What is more, non-verbal communi- 


VERBAL COMMUNICATION NON-VERBAL COMMUNICATION 


Vocal Spoken words 


Non-vocal Writing, sign language 


cation is often essential when con- 
veying information and making judg- 
ments about others (Hargie, Dickson 
2004). Birdwhistell (1955) even claims 
that up to 65% of the information in 
communication is received non-ver- 
bally. 


This form of communication con- 
sists of actions that are distinct from 
speech (Mehrabian 2017), thus differ- 
ent movements and emotions are de- 
termined, such as facial expressions, 
gestures, posture or other move- 
ments with the body, to name a few. 
Further, also paralinguistic and vocal 
phenomena, such as speech errors 
and pauses, speech rate, duration and 
many more, are included. 


To be more clear, Table 2.1 shows 
the division of verbal and non-ver- 
bal communication. Moreover, as can 
be seen, both verbal and non-verbal 
communication can be vocal as well 
as non-vocal. 


Paralanguage (pitch, volume, speaking 


rate, etc.) 


Body language (gestures, facial 
expressions, eye contact, etc.) 
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What needs to be emphasized, how- 
ever, is that isolating verbal and 
non-verbal communication is not as 
simple as it might seem in Table 2.1 
- they are intertwined and connect- 
ed, both of them supporting the oth- 
er in order to forward the meaning 
(Hargie, Dickson 2004). For example, 
complex communication phenomena, 
such as sarcasm is seen as non-ver- 
bal communication, yet also in this 
case verbal and non-verbal behaviors 
combine inconsistently to convey the 
actual meaning of the message (Meh- 
rabian 2017; Bugental, Kaswan et al. 
1970). Therefore, both forms are per- 
forming side-by-side, and are part of 
the same system. 


Although being tightly linked, there 
are diverse studies that discuss the 
dominance of one of the commu- 
nicational forms. Archer and Akert 
(1977), for example, found that people 
who are paying attention to non-ver- 
bal behaviors and not only to ver- 
bal cues, recognize emotions much 
more precisely. They studied people 
who were either watching a video or 
reading a text of an interview with 
two players after a basketball game. 
The participants had to answer which 
one of the players won. And surpris- 
ingly, the people who only read the 
text were much more mistaken with 


their answers. Whereas the ones who 
watched the video with facial ex- 
pressions, movements as well as the 
differing tone of voice, returned the 
right answer more often. Similarly, 
other researchers (Zuckerman, Li- 
pets et al. 1975) found that in order to 
understand how a person is feeling, 
non-verbal cues play a considerably 
more important role - and not only 
the tone of voice but genuinely focus- 
ing on one’s facial expressions. Fi- 
nally, in addition to the mentioned as 
well as many other researchers, also 
Bugental et al. (1970) found non-ver- 
bal cues to be more effective in terms 
of communication. 


Therefore, all of the studies illus- 
trated, can be arguments for arising 
misunderstandings in the instance of 
sending emails, or text messages, and 
consequently even more while con- 
versing with inanimate chatbots. 


FOLLOWING SEMIOTIC RULES 


Given the fact that communication 
can be either verbal or non-verbal, it 
is necessary to understand how peo- 
ple perceive what has been said or 
what was meant with the utterance. 


As previously mentioned, verbal com- 
munication includes the language of 


words and grammar. In order to un- 
derstand what is said or written, as 
well as meant by these words, some 
rules are needed. Otherwise, it would 
be extremely complex to understand 
what is meant with a word such as 
plant, and all the different forms, for 
instance, paltn, naplt etc, could have 
the same meaning. Even worse, any- 
thing or any word could be deter- 
mined as plant. 


Likewise, as Littlejohn and Foss (2010) 
indicate, the same goes for non-ver- 
bal cues. For example, 

when a person lifts 

one hand - depending 

on the overall context 

and other signs, such 

as emotions or words, 

it can mean different 

things: to greet, to stop, to show one’s 
presence, etc. 


Therefore, to make both verbal and 


nonverbal communication com- 
prehensible as well as meaning- 
ful, three different semiotic levels 


(Morris 1938) have been defined: 


1. Syntactics. This component of 
the triad is seen as a study of 
what and how is communicated, 
hence taking care that the ut- 
terance is structured in the cor- 


N 


rect way. To be more precise, it 
consists of the rules that dictate 
how to compile words in order 
to make a valid sentence. Con- 
tinuing with the example: if the 
word plantis used in a sentence, 
such as “Yesterday I bought a 
beautiful plant,” then grammar 
is needed. Therefore, syntac- 
tics handles with the struc- 
tures of symbols, such as words. 


. Semantics. The component il- 


lustrates what is meant with the 
word or action in a 
specific situation. Dic- 
tionaries can be seen 
as semantic refer- 
ence books since they 
explain what a word 
represents (Littlejohn, 
Foss 2010). For example, as al- 
ready illustrated, a word plant 
according to Cambridge Dictio- 
nary (2019) represents “a living 
thing that grows in earth, in wa- 
ter, or on other plants, usually 
has a stem, leaves, roots, and 
flowers, and produces seeds.” 


. Last but not least, pragmatics. 


The component indicates what 
is done, focusing on the context, 
the activity, and behavioral ef- 
fects. To be more precise, that 
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level addresses how the signs, 
such as words, make an im- 
pact on people's lives and help 
them to carry out actions. What 
is more, people use more than 
actual meanings of words, thus 
pragmatics explains how the 
language is used in communi- 
cation (Leech 1983), how people 
use the language in different 
contexts and therefore under- 
stand each other. For example, 
a sentence “I name it Lilly” il- 
lustrates an action of naming 
the plant, knowing the earlier 
context and what is meant by it, 
as well as a consequence - the 
plant is carrying a name, Lilly. 


What is relevant in terms of current 
work, is what Steven Pinker, a well- 
known cognitive psychologist, lin- 
guist, and professor at Harvard Uni- 
versity, brought out in an educational 
video (Pinker 2011). He posed a ques- 
tion: “So why do people understand 
language so much better than com- 
puters? What is the knowledge that 
we have, that has been so hard to pro- 
gram into our machines?” He suggests 
that it is the third interface standing 
between language and the mind - the 
pragmatics. Thus adds a humorous 
example of a person telling a robot to 
give him a hand. Instead of offering 


to help, what is actually asked for, the 
robot truly takes off its robotic arm. 


In everyday communication, humans 
use vast storage of knowledge about 
human behavior, human interaction 
and relationships to understand lan- 
guage and what is actually meant by 
what has been said. This is the chal- 
lenging segment of programming - 
perhaps, to speculate in advance, yet 
another source of the problem when 
communicating with chatbots. 


PERFORMING IN A PROCESS 


Subsequently, after illustrating ver- 
bal and non-verbal communication 
as well as how people make sense of 
what is said or expressed, it is rele- 
vant to zoom out and continue with 
focusing on the bigger picture and 
clarifying the overall process - how 
communication takes place. In or- 
der to understand communication 
as a process, recognize the main ele- 
ments, relationships and interactions 
between them, as well as compre- 
hend the depth and complexity, many 
models have been developed over the 
years. 


Since the present work does not aim 
to acquaint all of the models illustrat- 


ing communication processes, only 
relevant studies for the current paper 
will be introduced. To start with, the 
first model created by Shannon and 
Weaver will be discussed. Additional- 
ly, to illustrate the evolution of such 
models, three other outstanding con- 
figurations will be introduced. The 
current work appreciates and mainly 
relies on the evolution proposed by 
West and Turner (2010) since it sup- 
ports the remaining of the work. 


PROCESS AS ACTION 

The model that emerged in 1949, 
also known as Mathematical Theo- 
ry of Communication, is acknowl- 
edged as one of the main seeds out 
of which Communication Studies 
has evolved (Fiske 1990). In addition, 
it is recognized as a groundwork for 
many subsequent models (Johnson, 
Klare 1961). The reason for calling 
the model also Mathematical Theo- 
ry of Communication, in addition to 
the Shannon-Weaver model, comes 
from the fact that the authors were 
not social scientists, but instead en- 
gineers working at Bell Telephone 
Laboratories in the United States. 
Therefore, they studied radio and 
telephone technologies and aimed 
to develop a model explaining how 
information passed through various 
channels (West, Turner 2010) and how 


these channels could be used most ef- 
ficiently (Fiske 1990). Despite seeming 
highly technological, the model has 
claimed to be equally applicable to hu- 
man communication. Even more so, 
Johnson and Klare (1961) noticed the 
early model as a provocation for so- 
cial scientists to define their thoughts 
and theories of communication in the 
form of a model. 


Shannon and Weaver describe com- 
munication as a linear process, al- 
ternatively arrow communication 
(Hargie, Dickson 2004). Meaning that 
communication goes in one direction. 
In reality, communication is rarely as 
simple as a one-way process (Burton, 
Dimbleby 1998), yet it has been seen as 


a good point to start. 


As illustrated in Figure 2.2, the first 
component in the process is an infor- 
mation source that generates a mes- 
sage to be communicated. Therefore, 
the transmitter forms the message 
into a signal and sends it through the 
channel to the receiver. Again, the re- 
ceiver needs to translate the received 
signal into a message, in order to de- 
liver it to the destination. What is im- 
portant, the signal might be disturbed 
by noise and therefore the delivered 
message could differ from the initial 
message - the meaning could be dis- 
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tinct in the opposing ends. Further, 
communication could fail if the com- 
municators do not realize the split 
between the two messages (McQuail, 
Windahl 2015). 


To make it applicable to human com- 
munication and not only for tech- 
nology, the model has been human- 
ized by many authors (Chandler 1994; 
West, Turner 2010). Thus, information 
source and transmitter are addressed 
as the sender and additionally, receiv- 
er and destination are turned to as 
the receiver. What is more, in human 
communication the messages can be 
words, sounds, actions or gestures, 
therefore as stated earlier, verbal or 
non-verbal. The channel can include 
different senses - visual, tactile, ol- 
factory, as well as auditory. Finally, 
the noise is anything that was not in- 
tended by the information source, by 
the communicator. West and Turner 
(2010), as well as Lunenburg (2010), 
similarly contrast four types of noises 
as: 


1. Semantic. Taking into consid- 
eration jargon, slang and other 
specialized languages, used by 
groups or individuals. For ex- 
ample, complex medical terms 
used by doctors can have no 
meaning to patients. 


2. Physical. An external noise 
that exists outside of the re- 
wind 


ceiver. For instance, 


blowing in the background. 


3. Psychological. Meant as com- 
municator’s prejudices and bi- 
ases toward another or the mes- 
sage. For example, listening to 
political statements of a politi- 
cian who one does not support, 
is seen as psychological noise. 


4. Physiological. Involving biolog- 
ical influences on communica- 
tion. Such as one or both of the 
communicators being hungry 
or tired. 


On the one hand, as already men- 
tioned, the model has been extremely 
valued and seen as an important cor- 
nerstone for the whole field of Com- 
munication Study. Daniel Chandler 
(1994), a British visual semiotician, has 
stated that the model has gained pop- 
ularity thanks to being simple, general 
and quantifiable. Owing to these ad- 
vantages, many academic disciplines 
found it utile, thus attention was also 
drawn on human communication and 
its theories. 


On the other hand, the straightfor- 
ward model includes several lim- 


itations. To start with, it assumes 
that there is only one message in the 
channel at a given time, as well as that 
the communication has a defined be- 
ginning and end (West, Turner 2010). 
As already stated, communication 
is rarely, if ever, a one-way process. 


> Semantic 
——> Physical 


SENDER/SOURCE ——|> 


Semantic «~~ 
Physical 


PROCESS AS INTERACTION 

Coming from the fact that the linear 
model only examined communication 
in one way, five years later, in 1954, 
Wilbur Schramm suggested investi- 
gating the relationship between the 
sender and the receiver. Different re- 
searchers have given various names 
to that model, such as Circular Model 
(McQuail, Windahl 2015) or The Inter- 
actional Model (West, Turner 2010). 
Whilst the names differ, the primary 
point remains - communication is a 
two-way process - respectively illus- 


Noise 
MESSAGE = 


\ Noise 


What is more, there is an absence for: 
content and meaning; context; rela- 
tionships between communicators; 
and time (Chandler 1994). Therefore, 
keeping these restraints in mind, oth- 
er models were created. 


-» Physiological 


_~—» Psychological 


-> TARGET/RESOURCE 


Psychological «—- 
Physiological «~~ 


trated on the model in Figure 2.3. 


Therefore, the main difference from 
the Shannon-Weaver model is that 
communication is a process that 
flows from the sender to the receiv- 
er, and followingly, from the receiv- 
er back to the sender - the meaning 
is achieved through the exchanged 
feedback. In addition, being a circular 
model, it suggests that communica- 
tion is an on-going process, without 
beginning or end. The person can be 
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either sender or receiver, but not both 
at once (West, Turner 2010). What is 
more, if Shannon and Weaver focused 
their attention on the channel deliv- 
ering the message, then, in this case, 
the author emphasizes the impor- 
tance of the actors (McQuail, Windahl 
2015) - the sender and the receiver. 
Therefore, in order to work success- 
fully, the model depends highly on the 
feedback between the mentioned ac- 
tors, being either verbal or non-ver- 
bal, calculated or not. Feedback dis- 
plays if the message is received and if 
the meaning was perceived in the way 
it was implied by the sender. Howev- 
er, the feedback is given only after the 
message has been received, not while 
it is still ongoing (West, Turner 2010). 


What West and Turner (2010) addi- 
tionally emphasize is the importance 
of the field of experience. Meaning, 
that each person, the sender as well as 
the receiver, bring their own past ex- 
periences to the communication and 
thus it can either work for or against a 
successful communication. 


Similarly to the Shannon-Weaver 
model, also Schramm has gotten crit- 
ical feedback for his work. First, as can 
be anticipated, feedback does happen 
while the message is still being deliv- 
ered - it can be anything, even smile 


serves as feedback. Therefore, the 
implication that the sender cannot be 
the receiver at a given moment, and 
vice versa, is incorrect (West, Turn- 
er 2010). What is more, McQuail and 
Windhal (2015) see another error in 
the fact that the model suggests that 
the communicators are equal. Again, 
not the case in everyday communica- 
tions. 


Since Schramm’s circular model still 
included some limitations, the evolu- 
tion in terms of communication mod- 
els did not stop. 


PROCESS AS HELIX 

Since the preceding model is a circu- 
lar interpretation of communication, 
it seems as if the communication al- 
ways comes back to the point where 
it started (McQuail, Windahl 2015). 
Hence, in 1967 Dance’s Helix Model, 
proposed by a communication pro- 
fessor Frank E. X. Dance, was born. As 
the name suggests, the communica- 
tion process is similar to a spiral (Fig- 
ure 2.4) - dynamic and nonlinear, cir- 
cular and progressive (Rafaeli 1988). 
What is communication is 
evolving, and how communication 


more, 


will develop and what will be ad- 
dressed later, is dependent on what 
is communicated at the moment (He- 


Noise 


» MESSAGE 


N 
ow Noise Noise n 
2 S 2 Ẹ 
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i Ly y 9 
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© \ S, 
ne} D 
v \ A 
LL D 
FEEDBACK FEEDBACK 
CHANNEL 
Noise 
lical Model of Communication 2013). PROCESS AS TRANSACTION 


Also, there is no specific time for in- 
teracting, thus the sender and the re- 
ceiver are changing feedback actively 
as well as continually, to foster shared 
meaning. With time, the relationship 
between actors will develop as the 
illustrating circles will grow bigger, 
sometimes more, other times less 
(McQuail, Windahl 2015), but the com- 
munication and its elements are ev- 
er-changing (West, Turner 2010). 


Despite being a rather simplistic 
model to illustrate communication, 
the main benefit as well as addition, 
compared to the models listed above, 
is the reminder that communication 
is dynamic and evolving over time 
(McQuail, Windahl 2015). 


To take a step even further, one of the 
most helpful communication models 
in understanding face-to-face com- 
munication is the Transactional Mod- 
el - studied by Watzlavick et al. as well 
as Barnlund at the beginning of the 
1970S (Lyon 2017). Different from pre- 
vious models, the Transactional Mod- 
el (Figure 2.5) emphasizes the concur- 
rent sending-receiving process (West, 
Turner 2010) whereas the sender can 
be the receiver at the same moment. 
What is more, transactional com- 
munication is also cooperative, thus 
participants are mutually responsible 
for the effectiveness of the commu- 
nication and, more importantly, the 
meaning is built together - it is cu- 
mulative and grows as the verbal or 
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non-verbal cue is added (Barnlund 
2007). It can be said, that the meaning 
is negotiated and comes through the 
interaction - such that if communi- 
cator A is describing a situation and 
communicator B cannot understand 
some aspect, therefore indicating it 
with a baffled face, A will return to 
further explain the aspect such that B 
can understand - people do not un- 
derstand each other right away, but 
have to work towards mutual inter- 
pretation. 


Field of experience played a role al- 
ready in Schramm’s Model, how- 
ever, in the Transactional Model 


experience overlaps among the com- 


municators - illustrating the process 
of understanding - the more the ex- 
periences overlap, the more there is 
an understanding between the com- 
municators. What is more, Lyon (2017) 
believes these shared and unshared 
experiences shaping the communica- 
tion between people. Also, he brings 
out that the model suggests the di- 
mension of context - every time one 
communicates, the communication 
happens in a certain environment 
(such as school, home, etc) - whereas 
this context also shapes and influenc- 
es the way the messages are sent and 
received. Finally, he points to the re- 
lationship aspect - meaning that how 
something is said, is important, and 
it is perceived through the relational 
dynamic. 


The models illustrated, have shown 
the evolution of communication 
models and they emphasize the com- 
ponents of communication to keep an 
eye on. For example, different kinds 
of noises should be addressed, the 
communicators’ diverse fields of ex- 
perience cannot be underestimated 
as well as that the relationship should 
be evolving, and both sides working to 
build joint meaning. 


Noise 


Psychological Semantic Physical Physiological 
Message/Feedback 
Communicator Communicator 
Shared 
Field of expereince RIE Field of expereince 
being has experienced, as well as how 
WHY DO PEOPLE has been illustrated so far, communi- 
O O cation is a complex activity and there- 
SUCCEED IN fore might fail every now and then. 
COMMUNICATION? 


Thus far, the history and matter of 
human communication have been 
discussed, both in detail as well as an 
overall process - understanding what 
communication is and how people 
communicate - it is time to address 
why people manage to participate 
in the communication successfully 
and accomplish to deliver the shared 
meaning. 


Of course, as probably every human 


Communication happens uncon- 
sciously and people do not think much 
about it, therefore negative effects 
may occur. What is more, it has been 
examined, that disruption happens 
due to various types of noise elements 
entering the communication process 
(Lunenburg 2010). Different kinds of 
noises were discussed in the previous 
chapter. To recall, communication 
can break down as communicators 
are using an excessive amount of jar- 
gon or speak different languages, have 
opposing views or simply lack atten- 
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tion, encounter distractions or irrel- 
evance, to name a few. It is the task of 
the communicators to be conscious of 
these and many other hurdles, as well 
as attempt to decrease the poor influ- 
ence it might have on the communi- 
cation. 


As already mentioned, Steven Pinker 
(2011) stated that communication be- 
tween humans and computers often 
fails due to a lack of pragmatic com- 
petence. Humans are the primary ex- 
amples of, generally, strong commu- 
nication and they achieve it through 
the use of everyday language. Taking 
these facts into account, the author of 
the current work finds it appropriate 
to address pragmatics, the analysis of 
real language usage, in order to un- 
derstand successful communication. 


Before going in detail, it is import- 
ant to recall what pragmatics stands 
for. As Korta and Perry (2019) de- 
clared: “Pragmatics deals with utter- 
ances, by which we will mean specific 
events, the intentional acts of speak- 
ers at times and places, typically in- 
volving language.” British linguist, 
academic and author, David Crystal, 
stated (2014): “/.../ the definition of 
pragmatics it’s the study of the choic- 
es you make when you use language. 
The reasons for those choices and the 


effects that those choices convey.” He 
added: “/.../ pragmatic perspective is 
really essential because pragmatics 
answers the question ‘why?’” Meaning 
by that, pragmatics in general deals 
with the question of why are people 
using the language the way they use it. 
Coming from the analysis of different 
perspectives answering the overall 
question of why while addressing suc- 
cessful communication, the current 
paper gives the response through in- 
trospective theories and ethnograph- 
ic studies. 


INTROSPECTIVE THEORY 


In human communication and its un- 
countable diverse circumstances, it 
is often vital to choose words in or- 
der to not cause misunderstandings, 
hurt somebody or get into a conflict. 
Accordingly, many researchers have 
studied what should be said to get the 
real meaning delivered in a success- 
ful and favorable way. Thus, sever- 
al theories and principles have been 
proposed. In the current paper, as al- 
ready seen in the case of communica- 
tion models, the cornerstone theory, 
with its lasting influences on modern 
pragmatics, and some of the theories 
evolving from that one, are listed. 


To start with, Herbert Paul Grice, a 


“Make your 
conversational 
contribution such as is 
required, at the stage 
at which it occurs, by 
the accepted purpose 
or direction of the talk 
exchange in which you 
are engaged.” 


HERBERT PAUL GRICE, PHILOSOPHER 
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well-known philosopher of language 
and one of the early initiators of the 
field of pragmatics (Wilson, Sper- 
ber 2005), emphasized the difference 
of what the speaker says and what 
is meant by the saying (Korta, Per- 
ry 2019). He proposed a standard for 
harmonious human relationships, the 
Cooperative Principle: “Make your 
conversational contribution such as is 
required, at the stage at which it oc- 
curs, by the accepted purpose or di- 
rection of the talk exchange in which 
you are engaged.” (Grice 1975, p. 45). To 
rephrase and simplify, Grice aimed 
to indicate that people should say, as 
well as do what is needed. For exam- 
ple, if one asks for two bottles of milk 
from a marketer, the marketer should 
act accordingly and not give four, 
since it is not expected. 


As Grice himself saw the principle 
rather general, by echoing Kant he 
found four categories to define more 
specific maxims to favor the princi- 
ple: 


VAL MAXIMS 


COOPERATION 


What the author points out, is that the 
maxim of quality is the primary one. 
In fact, the other maxims are relevant 
only if that one, the quality, is satis- 
fied. 


Also, he did not mean that people al- 
ways think of and follow the maxims, 
but rather saw these assumptions 
as a critical base for communication 
(Spencer-Oatey, Jiang 2003). 


However, many of the researchers 
have found the Gricean maxims mis- 
guiding. To illustrate, Frederking 
(2004) even claims: “They are in fact 
harmful, because they form a mis- 
leading taxonomy.” Additionally, he 
suggests that all the maxims and the 
main principle could be reformulated 


very generally as “Do the Right Thing”. 


Slightly less critical, Wilson and Sper- 
ber (1981) appreciate the work of Grice 
and his contribution to pragmatics, 
but likewise, notice some shortcom- 
ings. First, they see that the contrast 
between what one says and means is 
not as evident as Grice claims it to be. 
Secondly, the researchers believe that 
it is not enough to know the maxims 
in order to clarify irony and meta- 
phors, although Grice seems to argue 
that the maxims are enough. Finally, 
Wilson and Sperber see the need for 
only one maxim. 


Accordingly, the Prin- 

ciple of Relevance was 

born. Although it does 

not exactly follow the 

Cooperative Principle, 

neither does it contra- 

dict with it - since the authors still see 
conversation as a collaborative activi- 
ty (Wilson, Sperber 1981). The primary 
idea of the principle is that the utter- 
ance itself raises expectations for be- 
ing relevant (Wilson, Sperber 2002). 
These expectations are as accurate 
and predictable as needed, to auto- 
matically guide the hearer towards 
the intended meaning. To go more in 
detail, Wilson and Sperber (1996) for- 
mulated the principle of relevance as: 
“Every act of ostensive communica- 
tion communicates a presumption of 


its own optimal relevance.” Thus, the 
researchers indicate that communi- 
cators do not need to follow the prin- 
ciple, as they see happening in the 
case of Gricean maxims, people do it 
automatically and therefore never vi- 
olate it. 


Similarly to the Cooperative Prin- 
ciple, Wilson and Sperber’s book 
“Relevance: Communication and 
Cognition” and thus the Principle of 
Relevance, have received criticism. 
Seuren (1986), for example, sees the 

Gricean approach more 

favorable for the fields 

of pragmatics and 
science in 
general. Additionally, 
he claims the book by 


Wilson and Sperber to 


cognitive 


be a revision of Gricean pragmatics, 
stating critically: “This book, however, 
offers nothing remotely like a properly 
developed Gricean perspective, and it 
is more likely to confuse experiment- 
ers than to enlighten them.” 


Similarly to the latter opinion, an- 
other acknowledged linguist, Geof- 
frey Neil Leech also decided to work 
in conjunction with the Cooperative 
Principle, rather than criticizing it 
(Spencer-Oatey, Jiang 2003). Although 
seeing the Cooperative Principle use- 
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ful, he believed it not to be sufficient. 
Therefore, he additionally described 
the Politeness Principle and six cor- 
relating politeness maxims (Leech 
1983): 


ESS MAXIMS 


POLITEN 


The Politeness Principle (or as Leech 
himself states, PP) comes togeth- 
er from all of the maxims, although 
initially, for better understanding, 
the maxims have been simplified to 
sub-maxims - previously marked as 
(a) and (b). Thus, Leech suggests re- 
formulating and using only sub-max- 
im (a). For example, the first maxim 


should go accordingly: “Minimize the 
expression of beliefs which express or 
imply cost to other,” and adds: “/.../ 
and the other maxims should be sim- 
ilarly expanded. In that they recom- 
mend the expression of polite rather 
than impolite beliefs, all of them come 
under the PP.” (Leech 1983). 


What is more, seen as the greatest 
difference and beneficial factor com- 
pared to Gricean maxims, is the per- 
sonal effect that politeness maxims 
bring to communication. Therefore, 
the outcome is more natural and in- 
cludes the attitude and behavior of the 
communicators, while the Gricean 
maxims suggest more structured and 
impersonal communication (En, Lan 
2012). 


Not only Leech but long before, even 
prior to the comprehensive rise of 
pragmatics itself, the authors of the 
book “Pragmatics of Human Commu- 
nication” already brought behavior 
and attitude to the center of atten- 
tion in human communication. To the 
extent that they even saw the terms 
behavior and communication being 
synonymous, at least for the prag- 
matic concepts (Watzlawick, Beavin 
Bavelas et al. 1967). The researchers 
stated: “/.../ Thus, from this perspec- 
tive of pragmatics, all behavior, not 


only speech, is communication, and 
all communication - even the com- 
municational clues in an imperson- 
al context - affects behavior.” (p. 22). 
Meaning, that behavior, verbal and 
non-verbal, influences communica- 
tion and communication, likewise, 
changes behavior. 


The authors brought five axioms for 
there- 
fore noting that miscommunication 


successful communication, 
can occur if some of these are not re- 
spected (Watzlawick, Beavin Bavelas 
et al. 1967; Watzlawick, Beavin 1967): 
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The axioms listed emphasize highly 
the relationship between communi- 
cators as well as the behavioral ef- 
fects. It is important to pay attention 
to the context as much as to the con- 
tent of the message, otherwise, the 
communication might fail. 


What applies similarly to all the listed 
theories about successful communi- 
cation, is that none of them truly em- 
ploys thoroughly to diverse cultures 
or languages other than English. The 
meaning of utterances changes not 
only interculturally, but also intracul- 
turally and additionally within time 
and space - therefore more thor- 
ough studies with people need to be 


considered to understand successful 
communication. 


ETHNOGRAPHIC STUDIES 


Coming from the mentioned diver- 
sities of different cultures, as well as 
varieties within one, several theories 
have evolved as a result of ethno- 
graphic studies. Therefore, a couple 
of proposals are included, to illus- 
trate a more thorough and thought- 
ful approach to why people manage to 
communicate successfully, how is it 
perceived and achieved among peo- 
ple within real-life contexts. 


Since the latter introspective theory 
by Watzlawick et al. focused highly 
on the behavior of the communica- 
tors, it is reasonable to continue with 
a similar matter - the conversational 
style. Deborah Tannen is a professor 
of linguistics and a well-known au- 
thor, mainly interested in everyday 
communication and how it influences 
relationships. Similarly, in her book 
“Conversational Style” she investi- 
gates how people communicate and 
how different people either succeed 
or fail to communicate with one an- 
other. 


Tannen (2005) discusses the conver- 
sational styles of people. She finds 


that anything said, is said in style - at 
a certain rate, at a certain pitch and 
amplitude, with certain intonation, at 
a certain point in an interaction. The 
author examines many scholars and 
therefore points out that the styles - 
or the aspects of everyday talk - vary 
between people, being dependent on 
gender, culture, ethnicity, age, class, 
regional background, and self habits. 


After analyzing six different people 
with unique styles, whereas having 
either more or fewer characteris- 
tics and linguistic devices (such as 
rhythm, surface linguistic features, 
and contextualization) similar to oth- 
ers, some conclusions were made. 
What is critical to notice while an- 
swering the question why do people 
succeed in communication?, is one of 
“When people's 
devices matched, communication be- 


Tannen’s findings: 


tween or among them was smooth. 
When they differed, communication 
showed signs of disruption or outright 
misunderstanding.” (Tannen 2005, p. 
184). 


Another researcher, anthropologist 
Dell Hymes, was similarly interest- 
ed in everyday communication, par- 
ticularly within different cultures 
(Littlejohn, Foss 2010). For this rea- 
son, he initiated the ‘ethnography of 
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communication’. Additionally, Hymes 
can be seen as a forerunner in differ- 
entiating langue, the linguistic code, 
and parole, the actual speech - by do- 
ing so, he aimed to move away from 
examining language as an abstract 
model, to addressing speech in eth- 
nographic fieldwork - language that 
is not only correct in grammatical 
(linguistic) point of view, but correct 
in socio-cultural context (Johnstone, 
Marcellino 2010). 


Alternatively to Tannen, Hymes pro- 
posed an ethnographic framework 
that concludes all the various factors 
that are involved in communication, 
not merely focusing on the behavior of 
communicators. He believed these el- 
ements to be relevant in understand- 
ing how communication achieves its 
goals (Wardhaugh 2006). 


His SPEAKING framework involves 
(Johnstone, Marcellino 2010): 


FRAMEWORK 


SPEAKING | 


If the communication aims to be suc- 
cessful, Wardhaugh (2006) claims, the 
speaker needs to pay attention to all 
of the eight factors listed above. Also, 
the researcher adds: “Speakers and 
listeners must also work to see that 
nothing goes wrong. When speaking 
does go wrong, as it sometimes does, 
that going-wrong is often clearly de- 
scribable in terms of some neglect of 


one or more of the factors.” (p. 249). 


Given the above, starting from the 
surface of the problem while attempt- 
ing to define communication and 
moving towards the core while seek- 
ing to understand why people man- 
age to communicate successfully, it is 
rather safe to say that communication 
is a highly complex activity - difficult 
to designate how it initiated and trou- 
blesome to give an ideal definition. 
What is more, thus far there is no one 
perfect model of how communication 
works as a process, yet it does so every 
day from year to year and even centu- 
ry to century. However, the commu- 
nication and the mediums keep rap- 
idly changing and today, humankind 
is facing the era of getting everything 
done by conversing with computers. 
As millions of years ago, the early hu- 
mans started to communicate with 
each other, first with gestures and 
simple commands, later with the help 
of natural language, communication 
with computers has evolved to the 
point where natural language is firmly 
becoming the desired form of inter- 
action. 


So far, human to human communica- 
tion has been analyzed. The follow- 
ing chapter will address the matter of 
communicating with computers. 
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As stated in the previous chapter, 
communication has been order- 
ly studied since the antique times 
but came to the spotlight in the 2oth 
century with the immense develop- 
ments in the field of technology - the 
emergence of photography, radio, TV, 
computers, the Internet, and later 
the mobile web. As Pearce (1989) de- 
scribed: “New technologies of commu- 
nication have empowered communi- 
cators to do more, faster, at greater 
distances, and with less effort than 
ever before, and they have greedily 
been put into play by those who would 
speak, write, listen, eavesdrop, moni- 
tor, organize, inform, persuade, edu- 
cate, or entertain.” What is more, he 
adds that as generations evolve, the 
communication will span even faster 
and reach further, with less effort and 
declined deformations of messages - 
what used to be not only impossible 
but unthinkable for the elite, is now 
achievable for everyone. Similarly, 
Bojaxhi et al. (2017) bring out that what 
20 years ago seemed like an accept- 
able material for science fiction mov- 
ies, is now a reality. 


Although, being of great help in ev- 
eryday life, the various communica- 
tion mediums also bring drawbacks. 
For example, everyday expectations 
and experiences are influenced by 


primary groups (friends and fami- 
ly), secondary groups (school, reli- 
gious institutions, and government) 
as well as mass media (Srivastava, 
Chaudhury et al. 2018). Therefore, in 
addition to being an informational 
source and reflecting public values 
and attitudes, mass media, as well as 
communicational technologies, shape 
these values and attitudes. In addi- 
tion, people can be connected all the 
time within a click or swipe, yet never 
before in the history of humankind, 
have there been so many suicides, di- 
vorces, and depressed people (Bojax- 
hi, Vrapi et al. 2017). To illustrate, dis- 
connection is noticeable everywhere 
- on the streets people are scrolling 
on their phones rather than observ- 
ing the surrounding environment, 
listening to headphones rather than 
talking to each other, taking snaps for 
memorizing rather than living in the 
moment. 


However, as stated and widely known, 
the developments in communica- 
tion technology carry great benefits. 
Some of them being evident in every- 
day communication, such as people 
having the possibility to stay close 
even when physically separated by 
thousands of kilometers or simply 
the speed and easiness to read the 
news. Other benefits might not be 
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that evident, for example, the influ- 
ences of the American TV show 76 and 
Pregnant. The reality series by MTV 
screens the difficult life of teenagers 
after having a baby at an early age 
and consequently, the show actually 
decreased the rate of unwanted teen 
pregnancy (Kearney, Levine 2015). 


Furthermore, the developments in 
the technological field have not only 
advanced communication among hu- 
man beings but have brought along 
the need and ability to communicate 
with the technolo- 

gy itself. Meaning, 

there has been a 

shift from comput- 

er-mediated com- 

munication (CMC) 

to human-machine 

communication (HMC) (Gunkel 2012). 
For example, in order to send an 
email to a fellow, one must first “com- 
municate” with his or her technologi- 
cal device, or even more so, when one 
literally asks for information straight 
from the computer. Yet, it brings up 
questions. How one perceives com- 
munication with a tool? Is communi- 
cation with and through computers 
even possible? Is such communica- 
tion instinctive? 


Trying to find answers to similar 


questions, Byron Reeves and Clifford 
Nass, in their research at Stanford 
University, constructed an equation: 
media = real life (Reeves, Nass 1996). 
The statement comes from a research 
project called Social Responses to 
Communication Technologies and ac- 
cording to the researchers: “/.../ indi- 
viduals’ interactions with computers, 
television, and new media are funda- 
mentally social and natural, just like 
interactions in real life.” (p. 5). Mean- 
ing that people follow the same inter- 
personal interaction rules with tech- 

nology, that they 

use when com- 
with 
one another. The 


municating 
research includes 

35 experiments, on 

the grounds of so- 
cial science findings, aiming to prove 
the proposed equation. To illustrate, 
the researchers conducted a study 
where they gave different personal- 
ities to two computers - one being 
“dominant” and the other “submis- 
sive”. First, the participants of the 
study easily grasped the designed 
personalities. Second, to deepen the 
study, the researchers paired half of 
the students with computers with 
similar personalities (dominant and 
dominant, submissive and submis- 
sive) and another half with the oppo- 


site ones (dominant and submissive). 
As a result, according to Watzlavick’s 
communication axioms, mentioned 
in the previous chapter, the students 
in a symmetrical relationship ap- 
preciated their technological devices 
more than the ones who had comple- 
mentary relationships. 

One of the most important findings 
coming from all of the experiments, 
highly valuable for the current study 
is: “If human-media interactions are 
social and natural, then there are a 
number of unexpected ways to im- 
prove the design of media. [...] When 
media conform to social and natu- 
ral rules, however, no instruction is 
necessary. People will automatically 
become experts on how computers, 
television, interfaces, and new media 
work.” (Reeves, Nass 1996, p.8). 


HOW HAS 
COMMUNICATION WITH 
COMPUTERS EVOLVED 
AND WHERE IS IT 
HEADING TO? 


Similarly to human-human com- 
munication, for a better overview of 
human-computer communication, 
it is vital to go back to the beginning. 


In 1890, Herman Hollerith designs a 


punch card system in order to cal- 
culate the census - he manages to 
do it in 3 years and saves the govern- 
ment $5 million (Zimmermann 2017). 
In 1933, Telex messaging network 
comes out with a mission to distrib- 
ute military messages and soon de- 
velops into a worldwide network of 
text messaging (Computer History 
Museum n.d.). In 1936, Alan Turing, 
an English mathematician and com- 
puter scientist, presents an idea of 
a universal machine that computes 
anything that is computable - inspi- 
ration for the modern computer con- 
cept is born (Zimmermann 2017). In 
1946, John Presper Eckert and John W. 
Mauchly build ENIAC, “the first gen- 
eral-purpose electronic computer” 
with memory and arithmetic capabil- 
ities (Frangoul 2018). These and many 
other dates illustrate the beginning 
of computer history. Although, the 
beginning as such, more important 
to the current work is the start of the 
human-computer interaction (HCI) 
field in the early 1980s. 


Until the late 1970s, roughly the only 
people who communicated and in- 
teracted with the computers were the 
information technology professionals 
(Carroll 2013). Therefore, they saw the 
need neither to focus on how the us- 
ers interacted with computers nor to 
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develop any other interaction form 
than the Command Line Interface 
(CLI). Technically, being a text-based 
interaction, they only used a keyboard 
to type in complex commands in or- 
der to view or manipulate the files. 
The computer was seen as an infor- 
mation processor (Nielsen 1993). 


As computers started to turn into 
tools (Nielsen 1993) and personal 
computing advanced, bringing com- 
puters into home contexts with reg- 
ular users from diverse backgrounds, 
there was an emerging need to make 
the symbiosis between man and ma- 
chine (Grudin 2012), the necessity to 
understand and better empower us- 
ers (Carroll 2013). Thus the Graphical 
User Interface (GUI) was born. Niel- 
sen (1993) suggests that if so far the 
user interfaces were function-ori- 
ented and users needed to type in the 
command, followed by the arguments 
to actuate the function, then starting 
from the late 1970s and early 1980s, 
the interaction turned object-ori- 
ented. Therefore, the users started to 
first access the object of interest and 
then adapted it by operating on it - 
the interface was turned inside-out, 
compared to CLI. For example, for 
deleting a file called Document in 
CLI, the user needs to first write the 
deleting command rm and then the 


file name Document. In the GUI, on 
the other hand, the user first accesses 
the file Document through graphical 
icons or other visual elements and 
simply chooses the function, from 
the list of commands appropriate for 
this object, delete or drags it into a 
graphical trash bin. Although for the 
experts, the GUI worked slower than 
CLI (Grudin 2012) and even today, 
many developers and other profes- 
sionals, still make use of the efficien- 
cy and utility of giving commands to 
the computer. Similarly, Carroll (2013) 
claims that GUIs were actually not 
that easy to learn and use in the be- 
ginning, people were simply not used 
to this kind of interaction and it did 
not familiarize any regular everyday 
interactions. Yet, being obvious these 
days, it is no more a problem, rather 
a cultural background or even an in- 
nate ability, to either double click or 
drag. By the mid-1980s, the evolution 
of the local area networking and the 
Internet brought change into HCI, 
the computers turned into commu- 
nication channels - users were now 
communicating with other people 
through computers (Carroll 2013). 


One step further, in 1989 Tim Ber- 
ners-Lee invented the World Wide 
Web. As he states: “The Web is simply 
defined as the universe of global net- 


work-accessible information. It is an 
abstract space with which people can 
interact [...] Its existence marks the 
end of an era of frustrating and de- 
bilitating incompatibilities between 
computer systems.” (Berners-Lee 
1996). Therefore, the goal of the Web 
was to be a place for shared informa- 
tion, through what people, as well as 
machines, could communicate - the 
interaction moved from desktop to 
web. 


Consequently, Web 1.0 was born. As 
Berners-Lee himself suggested, the 
first implementation of the web was 
“read-only” and its role, in gener- 
al, was rather passive - people could 
view the information provided by 
static web pages (Solanki, Donga- 
onkar 2016). Thus, similarly to the 
first communication model by Shan- 
non and Weaver, mentioned earlier, 
also the first generation of the Web 
hosted a one-way communication 
(Maida 2018). 


Web 2.0, a “read-write” Web, was in- 
troduced in 2004 by Dale Dougherty 
and Tim O’Reilly. With the new ap- 
proach, the websites moved from be- 
ing static content providers to a more 
dynamic model (Solanki, Dongaonkar 
2016), whereas the users could inter- 
act more freely (Aghaei, Nematbakhsh 


et al. 2012) and generate content 
themselves. Web 2.0 gave the world 
social media, as well as blogging, 
chatting, sharing video content, and 
other online interactivity forms that 
became popular and have managed 
to stay so until today (Solanki, Donga- 
onkar 2016). 


Although Web 2.0 kept evolving, the 
inventor of the World Wide Web, Tim 
Berners-Lee proposed a new layer for 
the web - Semantic Web. “In this ver- 
sion of the Web, sites, links, media and 
databases are “smarter” and able to 
automatically convey more meaning 
than those of today.” (Shannon 2006). 
Additionally, John Markoff (2006), The 
New York Times journalist, suggest- 
ed a term Web 3.0 that takes the next 
step, such that the Web would be less 
of a catalog and more like a guide. 
Berners-Lee stated: “People keep ask- 
ing what Web 3.0 is, |...] I think maybe 
when you’ve got an overlay of scalable 
vector graphics - everything rippling 
and folding and looking misty - on 
Web 2.0 and access to a semantic Web 
integrated across a huge space of data, 
youll have access to an unbeliev- 
able data resource.” (Shannon 2006). 
Thus, he illustrates the Semantic Web 
as an additional meaning segment of 
Web 3.0. What is more, while the ear- 
lier web versions are seen as a layer 
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of Syntactic Web (Liu 2007; Weigand, 
Paschke 2012), which scenarios are 
focused on the users interacting with 
other users or technologies, Seman- 
tic Web focuses on scenarios where 
electronic agents take the burden off 
the user and interact with other us- 
ers or electronic agents, on behalf of 
the user (Hornung, Baranauskas 2011) 
- thus, machines are thinking, not 
merely following the commands. 


The main goal of Web 3.0, together 
with the Semantic Web, is to link the 
existing data and share it among dif- 
ferent databases, to provide more ef- 
fective exploration to the users. For 
example, when the user buys plane 
tickets to New York, the system au- 
tomatically suggests restaurants to 
go to or hotels to stay in - in 2019, the 
described scenario of Web 3.0 is an 
obvious part of everyday interactions. 


Another obvious scenario and yet 
one more alternative - Web 3.0 is also 
known as the Mobile Web 3.0 (Jami- 
son 2012). Thus, the main elements il- 
lustrating it: the connectivity (always 
and everywhere), location awareness, 
and small screens, to name a few. The 
focus of HCI moved from web to mo- 
bile - design took a new direction, 
heading towards Mobile First. 

The more recent side of Web 3.0, that 


so far has not yet managed to domi- 
nate, is the Decentralised Web. In June 
2016, at the Decentralised Web Sum- 
mit, Berners-Lee pointed out: “The 
web was designed to be decentralised 
so that everybody could participate by 
having their own domain and having 
their own webserver and this hasn't 
worked out. Instead, we've got the sit- 
uation where individual personal data 
has been locked up in these silos. [...] 
The proposal is, then, to bring back 
the idea of a decentralised web. To 
bring back power to people.” (Hodg- 
son 2016). In a few words, the idea is 
to make the web once again reliable, 
private and fun. 


Even though Web 3.0 is still ongoing 
and speculations on when did it ac- 
tually start are actively continuing, 
there are already rumors about the 
Web 4.0 (Aghaei, Nematbakhsh et al. 
2012). Almeida (2017), in order to bring 
some clarity into the topic, brings out 
several definitions, or rather ideas, 
that have been stated for Web 4.0 
since 2009. The results of his study 
revealed: “/.../ Web 4.0 covers a set of 
multiples dimensions. Each of these 
dimensions offers a distinct, but si- 
multaneously comprehensive, view of 
the Web 4.0 paradigm,” adding that 
social computing - social networks, 
Internet of Things, Big Data, Artificial 


Intelligence, and Machine to Machine 
- will be the key players in the up- 
coming Web-era. Thus, it is obvious 
that the future will be social - already 
today and even more in the future, 
Conversational User Interfaces (CUI) 
will provide a new way to interact and 
communicate. 


Additionally, there are already spec- 
ulations about Web 5.0 and 6.0, along 
with the others. The current work 
does not aim to look so much ahead 
into the future, yet, before studying 
the CUIs in detail, there is one final 
interesting layer of the web that still 
needs to be addressed. Namely, the 
Pragmatic Web. 


As it goes for the semiotics, illustrated 


introduced the basis for allowing more 
efficient information use. Not only by 
providing a set of linked documents 
but managing the data in collections 
of knowledge stores with meaningful 
content and additional logic struc- 
tures. However, the authors of the 
Pragmatic Web Manifesto bring out 
- if the Web aims to be a thorough- 
ly communicational tool, Semantic 
Web is not sufficient for agreeing and 
modifying the shared meaning. That 
is where the Pragmatic Web comes to 
help as its vision is to: “/.../ augment 
human collaboration effectively by 
appropriate technologies,” as well as 
“[...] improving the quality and legit- 
imacy of collaborative, goal-oriented 
discourses in communi- 
lies.” (p. 76). 


earlier, it can be similarly stated in 


computer science - pragmatics lies 
beyond semantics. That was noted by 
Singh, in the early 2000s, whereas he 
emphasized: “/.../ just as the syntactic 
aspects have not died off when the 
semantics is considered but have instead 
become more rigorously defined, so 
too will the semantics flourish as the 
pragmatics expands.” (Singh 2002). 


As de Moor et al. (2006) state, the 
amount of information is ever-grow- 
ing and it became difficult to find in- 
formation needed, the Semantic Web 


Therefore the aim of the 
Pragmatic Web is to de- 
fine how and why, in re- 
lation to the context and 
intended purposes, the 
information is used (Liu 
2007) - the main position 
belongs to the processes 
and the context, in which 
the data is used, not to 
the data itself (Singh 2002). What is 
important, the scenarios include us- 
ers as well as electronic agents and 
primary topics are about contextual- 
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ized meaning, meaning negotiation 
and practices of virtual communi- 
ties (Hornung, Baranauskas 2011). 
Weigand and Paschke (2012) add that 
the Pragmatic Web can be seen as 
a view of the Internet that acts as a 
platform for communication and co- 
ordination - messages are viewed in 
the context of an interaction. As a re- 
sult, Hornung and Baranauskas (2011) 
hypothesize that when taking up the 
Pragmatic Web approach, the hu- 
man-computer interaction will result 
in data and services that are relevant 
for the users, and correlate with their 
actual needs, whereas providing the 
flexibility of use. 

Given the above, Figure 3.1 illustrates 


the developments of communication 
with computers over the last few de- 
cades. In order to understand the 
evolution of interaction and commu- 
nication with the computer, the past 
developments and future predic- 
tions for the system itself, have been 
demonstrated. 


As mentioned, initially the experts 
were communicating with computers 
by giving tricky commands through 
CLIs on their desktops. When com- 
puters started to emerge as everyday 
tools, the GUIs were designed. With 
the dawn of the Web, the interaction 
moved from desktop to web - at first 
to syntactic web-pages and later on 


to semantically connected meaning- 
ful data. The next step was the ap- 
pearance of small computers, better 
known as smartphones, and the in- 
teraction moved from web to mobiles 
- information got accessible every- 
where and every time. Today, as the 
amount of data in the web has gotten 
elusive and users long to access data 
on the go, new means are researched 
to make the communication even 
faster, more natural as well as rel- 
evant to the users. Thus, the Web is 
moving towards communicational 
and collaborative future - the Prag- 
matic Web. The rising interest in con- 
versational interfaces can be seen as 
one hint. 


WHAT ARE 
CONVERSATIONAL 
INTERFACES? 


In 2016, Conversational Interfaces or 
Conversational User Interfaces (CUIs) 
started to be in the center of focus in 
every other article about technology 
or innovation. Chris Messina (2016), a 
well-known product designer with a 
background in Google and Uber, stat- 
ed: “2016 will be the year of conver- 
sational commerce”. In an interview 


for Business Insider, Satya Nadella, 
Microsoft’s CEO claimed: ”/.../ pretty 
much everyone today who’s building 
applications, whether they be desk- 
top apps, or mobile apps, or websites, 
will build bots as the new interface” 
(Weinberger 2016). Mark Zuckerberg 
envisioned them as a substitution for 
apps, or at least as a fresh alternative 
(McMillan 2016). 


Before analyzing if the predictions 
thus far have come true, it is crucial 
to understand what Conversation- 
al Interface prefigures. Generally, 
an interface is conversational when 
it allows the user to interact, hence 
achieve a result, while communicat- 
ing with the system in natural lan- 
guage (Choque-Diaz, Armas-Aguirre 
et al. 2018). McTear (2017) identifies 
as CUIs the interfaces using speech, 
text, touch, and various other input 
and output methods. However, when 
touch, gestures, and other cognitive 
aspects, such as facial expressions 
are used in an interaction, diverse 
researchers (Liu 2010; Loureiro, Ro- 
drigues 2011) refer to these as Natural 
User Interfaces (NUIs). To illustrate 
more, these interfaces have been di- 
vided as Spoken Dialogue Systems 
(SDSs), Voice User Interfaces (VUIs) 
or Virtual Private Assistants (VPAs) - 
such as Apple’s Siri or Amazon’s Alexa, 
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with what users can interact while 
speaking. Also, Embodied Conversa- 
tional Agents (ECAs) are addressed as 
using animated characters with ges- 
tures, facial expressions, posture, and 
speech. Last but not least, chatbots 
or chatterbots are the interfaces that 
converse with the human through 
text, similarly to human-human text 
messaging. 


As illustrated, Conversational Inter- 
faces come in many forms with di- 
verse purposes. Yet, since the current 
work cannot cover all the different 
forms of Conversational Interfaces, 
the text-based chatbots are in specif- 
ic interest here. 


CHATBOTS IN FOCUS 


THE ORIGINS 


Chatbots as such, are not new con- 
cepts in general - Alan Turing first 
asked the question “Can machines 
think?” in 1950 (Gunkel 2012). Despite 
the growing popularity in recent years 
for goal-based chatbots that support 
the user in achieving a specific goal, 
the first attempts to build them trace 
back to the 1960s, into the MIT labs. 
Namely, Joseph Weizenbaum built 
chatbot ELIZA, a Rogerian Psycho- 
therapist, in 1966. Yet, it did nothave a 


goal as such (for example, to help the 
user order food), but to simply keep 
conversing with a human (Weizen- 
baum 1966). Although ELIZA was us- 
ing pattern-matching technique and 
did not actually understand what the 
human was saying, it was an inspira- 
tion to many latter chatbots and espe- 
cially the ones tricking the user into 
thinking that they are talking to oth- 
er human beings (Abu Shawar, Atwell 
2007). 


As technology has evolved, chatbots 
have started to get smarter - to ac- 
tually understand the human lan- 
guage and therefore learn from the 
utterances. There are chatbots, such 
as Microsoft’s XiaoIce in China, that 
does not necessarily solve the user's 
problem, like most chatbots these 
days, but instead aims to be social 
- a virtual companion to chat with 
(Shum, He et al. 2018), likewise ELIZA 
was built more than 50 years ago. In 
contrast to ELIZA, mentioned chatbot 
learns every day how to be more hu- 
man, using AI framework with deep 
learning techniques (Spencer 2018). 


Since the current work does not aim 
to redesign or propose new and effec- 
tive solutions to the technology, a brief 
overview of the building components 
has been given. From here, the work 


will continue to describe the reasons 
why chatbots have come an important 
point of interest in the recent years, 
despite having been around already 
from the 1960s. 


THE FITTING CIRCUMSTANCES 

“We're in the midst of a once-in-a- 
decade paradigm shift. Messaging is 
the new platform, and bots are the 


new apps. The shift radically chang- 
es end-user experiences and devel- 
oper frameworks and inevitably will 
change business models, how we mon- 
elize, and how we advertise.” (Sheth 
2016). 


The announcement mediated in Ven- 
tureBeat, a source for the latest tech- 
nology news, seems to be right since 
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the popularity of messaging apps is 
ever-growing. Four out of ten most 
popular smartphone applications 
in 2018, with the highest number of 
monthly active users throughout the 
whole world, were instant messaging 
apps as illustrated in Table 3.1 (App 


Annie 2019). 


As of July 2019, the applications ranked 
in the mentioned list, host billions of 
people in a month (Figure 3.2). Name- 
ly, every month there are 1.6 billion 
active users on WhatsApp, 1.3 billion 
in Facebook Messenger, WeChat has 
more than 1.1 billion monthly users 
and QQ 823 million (Clement 2019b). 


The fact that messaging platforms 
are so popular, gives a great starting 
point also for chatbots. According to 
Gartner, coming from less than 2% 
in 2017, 25% of customer service and 
support operations in 2020 will run 
through chatbots or other virtual cus- 
tomer assistants (Moore 2018). In May 
2018, Facebook announced that af- 
ter 2 years in action, its bot platform 
hosted more than 300 000 chatbots 
(Johnson 2018). In addition to instant 
messaging applications, chatbots can 
be found performing in other stand- 
alone apps or operating on various 
websites to support customers. 
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THE BENEFITS OF USE 

There are different reasons, in ad- 
dition to the popularity of real-time 
messaging apps, behind such good 
indicators. To start with, perhaps 
most importantly, chatbots provide 
an interaction that is natural for hu- 


man beings - just like people use lan- 
guage to communicate with each oth- 
er, they also want to use it to interact 
with computers (Abu Shawar, Atwell 
2007). One might question if texting 
is as natural - Deborah Tannen (2013) 
stated that “text” and “talk” are not two 
different entities, but “overlapping 
aspects of a single entity”: discourse, 
or communication. She adds, join- 
ing other researchers, that the use of 
social media and messaging applica- 
tions is not much different from what 
has always been done with speech in 
social interactions - she sees it sim- 
ply as doing something old in a new 


WhatsApp 


Facebook Messenger 


WeChat 


QQ Mobile 


Snapchat* 


Telegram 


way. Additionally, it was reported that 
chatbots are equally desirable for age 
18-34 and age 55+ (Drift 2018). Since 
the interaction is natural, it has the 
potential to improve online experi- 
ences for consumers, regardless of 
age and proficiency in the use of tech- 
nology. People are used to keeping 
private relationships via texting, this 
personal communication can extend 
also to services and businesses and, 
additionally, users can be in charge of 
the communication themselves, since 
they have the freedom to respond, 
mute or even delete the thread (Klop- 
fenstein, Delpriori et al. 2017). 
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Second, the benefits include the utili- 
ty and simplicity. McTear (2017) points 
out the fact that users do not need 
to download an application to use 
chatbots. That is, of course, when the 
chatbot is not implemented as a fea- 
ture of an application. He adds anoth- 
er advantage for chatbots, specifically 
for the ones running on messaging 
applications - since the users are al- 
ready familiar with messaging appli- 
cations and they function in the same 
way across different operating sys- 
tems, such as iOS and Android, there 
is consistency - users already know 
how the interface looks like, how to 
use it, and developers do not need to 
build various versions. What is more, 
users can approach chatbots 24/7 and 
the chatbots on messaging platforms 
keep the history, thus the user has the 
freedom to turn back to explore past 
information (Klopfenstein, Delpriori 
et al. 2017). Also, the overall approach 
results to be more personal since the 
companies, for example, can gather 
the information necessary for pro- 
viding customized offers targeted 
directly to this user, at the right time 
(Zumstein, Hundertmark 2017). 


Another important factor for users is 
the UI. As already mentioned, there 
is consistency throughout different 
platforms - thus, the user does not 


need to discover nor learn, as is the 
case for diverse applications and web- 
sites. Although the term chatbot hints 
for chatting, just as humans send pic- 
tures, audio files, videos or emojis to 
stimulate the messages, there are the 
same options available for chatbots. 
It is true, they do not include much 
of GUI in general, but even a static 
link can be sent in a more appealing 
way than a simple URL, such as for- 
matted cards. Also, various options 
can be displayed to the user through 
carousel elements. To keep the com- 
munication going and, hopefully, on 
the right track, quick reply buttons are 
often given to suggest the messages 
that the user can send to the bot. Fi- 
nally, many of the chatbots allow the 
user to access a menu for immediate 
navigation. 


To go more in detail with domains, 
chatbots are used to control mental 
health for example. One such, called 
Pocket Skills was designed to support 
Dialectical Behavioral Therapy (DBT). 
As the study showed, after 4 weeks 
all the participants had considerable 
improvements in depression, anxiety, 
and DBT skills use (Schroeder, Wilkes 
et al. 2018). Similarly, another study 
was conducted on the Wysa app, that 
aims to build mental resilience and 
promote mental well-being using a 


text-based conversational interface. 
After a 2-month period, significant 
improvements in severe depression 
symptoms were noted for the users 
who used Wysa often, compared to 
the ones who did not use it as much 
(Inkster, Sarda et al. 2018). 


In addition, chatbots offer access to 
services for everyday utilities to make 
users’ lives easier. It is possible to or- 
der food, manage e-commerce pur- 
chases, book plane tickets, order a 
taxi and so on. 


So far, the benefits of chatbots have 
been illustrated - most of the chat- 
bots these days are meant to help to 
facilitate people's lives and their in- 
teractions with computers in a natu- 
ral manner. 


Ina study conductedin the USA by Brandtzaeg of 


Although, it is important to note that 
the aim of chatbots should never be 
to substitute a human being or imi- 
tate the conversation perfectly (Abu 
Shawar, Atwell 2007). 


THE ASPIRE TO ADVANCE THE DESIGN 
To generate new and valid results, 
vet to not reinvent the wheel, the 
state of the art of designing chatbots 
needs to be discussed. First, it is vi- 
tal to address the rationale behind the 
fact - 2020 around the corner, chat- 
bots have not taken over the world as 
promised at the beginning of 2016. 


Despite having countable benefits in 
the use of chatbots and the possibility 
to be a powerful tool, there have been 
many disagreements in the issue of 
usefulness lately. As the current work 

started the topic 
Conversation- 


and Folstad (2017), that aimed to learn the 
main motivations for employing chatbots, it 
was evident that people are mostly (68% of 
the participants) willing to use chatbots for 
productivity purposes. 20% of them said that 
they would use chatbots for entertainment. 
What is more, 10% thought of chatbots as a 
novelty technology and the curiosity drove 
them to test chatbots’ abilities. And similarly 
to the latter, another 10% of participants, saw 
them as an opportunity to avoid loneliness - 
for social and relational purposes. 
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consider the opposing thoughts that 
have started to loom. Even the very 
same article in The Wall Street Journal 
emphasized the fact: “But first, they'll 
need to get a lot smarter.” Wired, a 
magazine focus- 

ing on emerging 

technologies and 

their 
es on politics, culture, and economy, 
asserted that: “No, Facebook’s chat- 
bots will not take over the world” (Si- 


influenc- 


monite 2017). In addition, it has been 
stated that 70% of Facebook Messen- 
ger chatbots are failing (Gilliland 2017) 
and in general, 65% of consumers still 
prefer to talk to human agents (Audet 
2018). Finally, USA Today reported in 
2017 the thoughts of Forrester Re- 
search analyst, saying that it is still 
the very beginning for chatbots and 
it will take more than five years until 
they will start providing meaningful 
experiences (Graham 2017). The var- 
ious arguments in popular publica- 
tions do not stop here. 


As can be noticed from the articles, 
one strong argument goes for the 
need to make the technology better. 
No doubt, itis one of the main reasons 
why communication fails and despite 
recent advancements with social 
chatbots, such as Microsoft’s XiaoIce 


mentioned before, human-level in- 


telligence is not yet fully understood. 
Also, it will still take some time to be 
effective, whereas the main challeng- 
es in the AI field include: empathic 
conversation modeling, knowledge 
and memory 
modeling, inter- 
pretable and con- 
trollable machine 
intelligence, deep neural-symbolic 
reasoning, cross-media, and contin- 
uous streaming artificial intelligence, 
and modeling and calibration of emo- 
tional or intrinsic rewards (Shum, He 
et al. 2018). 


However, Xiaolce can engage users 
in rather long conversations, under- 
stand their needs and build an emo- 
tional connection while giving advice 
and offering support. XiaoIce can un- 
derstand human emotions and act on 
them, recognize the content of a pic- 
ture, comment on it, and even create 
poems. 


Similarly, in March 2016, Microsoft 
launched Tay, a chatbot on Twitter to 
engage and entertain people most- 
ly between the ages 18-24 with play- 
ful and casual conversation (Hunt 
2016). The more people chatted with 
it, the smarter it got. Seen as one of 
the greatest failures of chatbots, Tay 
became a racist chatbot with unbear- 


able tweets in less than 24 hours. It 
was smart enough to learn from users 
what to say, but irresponsible for do- 
ing so since it did not have any filter. 


Another example of a “too intelligent” 
chatbot is IKEA’s Anna, that retired 
in 2016, after being one of the first 
chat-based virtual assistants on the 
market. IKEA told BBC: “If you try too 
hard to be natural, it diverts from the 
real purpose of it, which is about giv- 
ing the right answer as fast as possi- 
ble.” (Wakefield 2016). Meaning, Anna 
failed since it could not do the online 
assistant chores and thus answer the 
direct questions. Instead, it tried to 
sound highly human-like and forgot 
its business purpose. 


As can be seen, technology is not 
the only substantial component of 
a well-working chatbot, thus other 
properties need to be designed ap- 
propriately as well. Therefore, vari- 
ous scholars have addressed diverse 
issues and challenges. McTear (2017), 
for example, posed general questions 
about: the design of multi-turn con- 
versations, as well as the clarifica- 
tions and follow-up queries; how to 
approach the context where the con- 
versation takes place; the handling of 
other pragmatic elements, such as in- 
directness; as well as behavioral fac- 


tors. 


To start with, Zumstein and Hunder- 
tmark (2017) affirmed the fact that 
chatbots are not completely novel and 
people are aware of them, although 
not many use them on a regular basis. 
They assume that users are still used 
to familiar communication channels 
(such as phone, email, app or website) 
and it will simply take more time to 
get comfortable with chatbots. What 
is more, they suggest that implement- 
ing them on instant messaging plat- 
forms might not be the best idea and 
in the research they discovered that 
users would prefer the chatbot to be 
integrated into an existing app, rather 
than on Facebook Messenger or other 
similar platform. Despite the popu- 
larity of instant messaging, as well as 
having some digital distribution web- 
sites, such as the AppStore or Google 
Play for apps, the discoverability of 
chatbots on messaging platforms re- 
mains a critical issue (Klopfenstein, 
Delpriori et al. 2017). 


To go more domain-based, chatbots 
are seen as highly beneficial help 
in terms of monitoring the mental 
health of a user. However, physicians 
do not believe that chatbots are ad- 
vanced enough to provide help in 
terms of complex decision-making 
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tasks and medical experts’ opinions 
are still crucial (Palanica, Flaschner 
et al. 2019). In general, Klopfenstein et 
al. (2017) advise to deliberate the use 
of them - not all applications and ser- 
vices are suitable to be displayed via 
chatbots. 


One great trouble the users are hav- 
ing, is comprehending the context 
and understanding each other. Thus, 
Jain et al. (2018) addressed the issues 
with it and designed an interface that 
displays the context (chatbot con- 
stantly displays how it is understand- 
ing the user at the moment) and al- 
lows the user to edit or remove it. The 
study showed that users preferred the 
chatbot with the additional feature as 
they found it easier to use, intuitive, 
mentally less demanding, as well as 
faster. What is more, chatbots should 
include a well-designed onboarding, 
therefore inform the user about the 
possible functionalities and follow- 
ing interactions as well as offer al- 
ternatives (Klopfenstein, Delpriori et 
al. 2017). Similarly, Valério et al. (2017) 
analyzed and evaluated the different 
techniques that chatbots apply to in- 
form the user about its competencies. 


In terms of communication, simi- 
larly to the study mentioned earlier, 
where Reeves and Nass (1996) were 


proving an equation of media = real 
life, a more recent study specifically 
about chatbots was conducted. Mou 
and Xu (2017) studied the differences 
in social communications between 
human-human and human-chatbot 
interaction. Opposing to the media 
equation, they found that humans 
showed more socially desirable char- 
acteristics while chatting with other 
humans, in contrast to chatting with 
a chatbot. Meaning, if the users are 
aware of speaking to an AI, they will, 
for example, be less open as well as 
use amore limited vocabulary. On the 
other hand, similarly to Reeves and 
Nass, the study showed that people 
like interaction with a chatbot more 
when its personality is similar to 
theirs. What is more, Thies et al. (2017) 
found that the bot’s personality even 
defines the interactions and the top- 
ics of conversation. 


Additionally, Go and Sundar (2019) 
found that the identity cue of the 
chatbot, being either a human-like 
picture or an illustrational icon, in- 
fluences the expectations for the per- 
formance. This supports also many 
other scholars (for example Klopfen- 
stein, Delpriori et al. 2017; Ciecha- 
nowski, Przegalinska et al. 2019) who 
have emphasized the importance of 
not hiding the fact that the user is 


talking to a computer, otherwise, the 
expectations will be higher and the 
resulting satisfaction lower. 


Even more, Klopfenstein et al. (2017) 
argue that the term “chatbot” itself 
sets high expectations. Since today 
many of the existing bots are not sim- 
ulating natural language and the us- 
ers are giving inputs with preserved 
utterances, known as quick replies, 
people cannot really “chat” with them. 
Thus, they propose a term “botplica- 
tion” to use for these sorts of bots. 
They advise to appreciate the sim- 
plicity and effectiveness - avoid using 
natural language, and employ quick 
replies if possible. They emphasize 
that due to natural language, it is easy 
for the users to “get lost” since they do 
not know which commands or syntax 
to use to achieve a desired goal. Simi- 
larly, Zue and Glass (2000) also argue 
if chatbots should mimic natural hu- 
man-human communication, or stay 
in a more structured, or one might 
say robotic, level. Ciechanowski et al. 
(2019) studied the effects of “uncan- 
ny valley” - the negative impacts that 
appear when interacting with a com- 
puter that is highly similar to a human 
agent, such that it becomes hard to 
distinguish. They expected the emo- 
tional and physiological responses 
to be most intense when interacting 


with an avatar, instead of a simple 
text-based chatbot - thus the uncan- 
ny valley effect would be stronger. 
This came out to be true - people saw 
the experience more positive as well 
as pleasant when talking to a chatbot. 
Meaning that they were physiologi- 
cally aroused when interacting with 
an avatar that tried to imperfectly im- 
itate a human being. 


What is more, Heo and Lee (2018) de- 
scribe a case study for the Naver Talk- 
Talk chatbot platform. Initially being a 
common natural language chatbot, it 
was soon developed into a card-based 
one. The rationale is that people did 
not know what to talk with the chat- 
bot and saw it rather inconvenient. 
The authors state that chatbots do not 
work only with natural language and 
providing suitable scenarios to the 
users is crucial. Doing that, the re- 
sponse rates increased significantly. 


Analysts and various technology ex- 
perts have ensured that conversa- 
tional interfaces have come to stay 
- the need for them is growing con- 
stantly as humankind races towards 
the Pragmatic Web. In the excess of 
data, the service providers dream of 
letting the users speak with comput- 
ers in a conversational manner, to fa- 
cilitate easier information finding and 
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“Can machines think?” 


more meaningful experiences with 
their services. 


There are numerous benefits to using 
chatbots. Due to the usage of natural 
language and familiarity, everybody 
would be able to use technology and 
access information in an easy way. 
Chatbots aim to make everyday life 
more productive and smooth. What is 
more, these conversational interfaces 
could be of great help when dealing 
with loneliness or other mental health 
questions, to name a few. 


Despite great arguments as well as 
favorable predictions a few years ago, 
chatbots have not obtained a wide 
usage. Thus, researchers discuss the 
shortcomings of chatbots, mainly 
technological, yet also the ones con- 
cerning UI. Many others have tried 
to understand the communication as 
well as the humanness of chatbots, 
anthropomorphism, and the extent 
it should cover. The understanding of 
how communication works between 
humans and chatbots, as well as how 
to make the interaction better, have 
been studied in diverse ways. 


Coming from the state of the art, cur- 
rent work argues that there is a need 
to understand how users perceive the 
communication and which are the 


main pragmatic shortcomings behind 
the notion. 
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The methodology of the current work 
consists of a detailed overview of 
qualitative research - what was the 
question that needed to be answered, 
how was the study conducted, who 
were the participants, which tools 
were used to help carry out the study, 
and how was the final data analysed. 


RESEARCH QUESTION 


As the theoretical framework de- 
scribed, within millions of years hu- 
man-human communication has 
once overcome the same hurdles as 
human-computer communication 
has outpaced in the last few decades. 
Similarly, people started communi- 
cating with each other by pointing 
and giving simple commands, initial- 
ly without much of a structure. Ever 
since, human communication has 
been studied and more thoroughly so, 
from the 2oth century. Different phi- 
losophers and linguists have analyzed 
successful communication and thus 
discovered one groundsel being the 


pragmatic layer. 


Recently, various researchers have 
proposed the adoption of the prag- 
matic layer also for the Web. Coming 
from the fact that the amount of data 


has become immense, interaction is 
expected to evolve to become more 
conversational and allow negotia- 
tions. Thus, it is evident that conver- 
sational interfaces, such as chatbots, 
play an important role in this act. 


Despite being extremely endorsed 
in 2016, the hype of the chatbots has 
started to fade and communication 
with them is often seen as failing. Yet, 
it is believed that the time of chatbots 
has not yet arrived, thus designers 
should find solutions to make the in- 
teraction more meaningful to support 
the success of this future communi- 
cation tool. 


As mentioned in the previous chapter, 
people perceive computers as social 
actors and texting is claimed to have 
the same communicational values as 
speech. Therefore, the current study 
finds it appropriate, similarly to other 
researchers (for example Gnewuch, 
Morana et al. 2017; Zue, Glass 2000) 
to base the entity of human-chatbot 
interaction on the grounds of human 
communication. 


Many researchers have studied the 
technological drawbacks, others have 
focused on the anthropomorphism of 
chatbots. To the knowledge of current 
work’s author, no other study so far, 
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has focused on how users perceive the 
experience directly from a pragmatic 
point of view. Of course, research- 
ers have used pragmatics before, for 
example En and Lan (2012) applied 
Politeness maxims to design the di- 
alogue with a robot, and similarly, 
Hall (2018) suggested to use Gricean 
maxims for interacting with chat- 
bots. Likewise, current work aims to 
look beyond the technical deficits and 
investigate the pragmatic aspects of 
human-chatbot communication to 
understand how they influence the 
overall user experience. Thus, the aim 
is to find an answer to: 


How do users perceive the pragmatic 
shortcomings in communication with chatbots? 


PROCEDURE OF THE 
STUDY 


Coming from the research question 
and the desire to get to know users’ 
thoughts and impressions of the ex- 
perience, as well as address their real 
needs, in-depth semi-structured in- 
terviews (Appendices A1) were con- 
ducted (Nielsen 2010) to carry out 
the study. The use of a qualitative re- 
search method enabled to address not 


only what the participants thought, 
but additionally drew attention to the 
aspect of why did they think so - thus, 
not only did it give answers, but it also 
gave reasons to these answers. Since 
the aim of the work was to provide a 
descriptive outcome and investigate 
communication, it was beneficial to 
similarly study the problem in a com- 
municative and descriptive manner - 
hence, the qualitative research. 


The data was accumulated through 
open-ended questions to allow ex- 
ploration, favor freedom to express 
thoughts, and not lead the participant 
in any target- 
ed direction 
(Rosala 2019b). 
Additionally, 
the use of semi-structured format 
enabled the researcher to ask fol- 
low-up questions to understand the 
views more thoroughly and collect 
additional information. Yet, it is cru- 
cial to note that the core of the inter- 
view needed to stay the same for all 
of the participants, in order to allow 
analysis and comparison of the data. 


The interviews were carried out on- 
line and primarily through Skype. 
That enabled screen, video, as well 
as audio recordings, to support im- 
mediate playback and, as mentioned, 


analysis by the researcher in the lat- 
er phases. On the one hand, seen as 
a benefit, the participants were able 
to stay in familiar environments, sep- 
arated by the screen and participate 
in a way that is common throughout 
the world for personal and business 
matters - video calling. Perhaps it 
helped them to feel more comfortable 
and less as an object of investigation 
throughout the whole interview. On 
the other hand, the researcher was not 
able to fully read the body language of 
the participants as well as minor con- 
nection problems occurred. These 
were the drawbacks that the author 
of the current work needed to take 
into consideration and that would not 
have been the case for face-to-face 
interviews. 


Also, since qualitative research and 
in-depth interviews are time con- 
suming, it needs to be considered 
that fewer people were analysed and 
the results cannot be generalized to a 
wider population, as would be while 
carrying out a quantitative study. Yet, 
once again, the chosen method al- 
lows in-depth understanding of the 
participants’ thoughts and percep- 
tions. Additionally, coming from the 
requirements, the research was pre- 
pared and carried out by one facilita- 
tor only, thus the results might have 


been different with the diverse skills 
of various researchers. 


To empower the study, in addition to 
the open-ended questions, the inter- 
view included a minor hands-on us- 
ability activity with an existing chat- 
bot, “Eddy Travels”. That was seen as 
a vital part, since itwas not known or 
compulsary that the users had had an 
experience with a chatbot prior to the 
study. What is more, human memory 
is faulty and people cannot remember 
the details of the previous usage (Niel- 
sen 2010). Thus, a brief application of 
the chatbotwas necessary. This gave a 
slight opportunity for data triangula- 
tion (Nielsen 2010), since it allowed a 
glimpse into behavioral insight rath- 
er than attitudinal judgement - thus, 
answered a question of what people do 
rather than what people think (Rohrer 
2014). 


Finally, in order to be adamant about 
the success of the study and to en- 
sure it helps to answer the research 
question, pilot interview was con- 
ducted. The party was not aware of 
participating in a pilot and was not 
treated any differently. This was sim- 
ply completed to adjust the interview 
questions and add additional clari- 
fications, prioritize them, as well as 
understand the approximate dura- 
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tion, and guarantee smooth run for 
the final study (Schade 2015). It turned 
out as valuable interview with equally 
important insights. 


WARM-UP AND THE TASK 
SESSION 


Each study began with a warm-up 
session. First, it was important to go 
through the users’ rights and instruct 
them to think out loud throughout the 
study in order to get deeper insights. 
To get the participants to do so, they 
were reminded that there were no 
right or wrong answers and that 
the facilitator was not testing their 
knowledge. Therefore, it ensured to 
the participants that there will be no 
judgement and they can think freely 
and open up. Additionally, it was cru- 
cial to go over the fact that the partic- 
ipants would be well aware of the re- 
cording of the session and retention 
of the recordings. 


Followingly, introductory questions 
were needed to help the participants 
open up and get them into the mind- 
set of the topic. This part of the study 
was used as a transition to the cen- 
tral topic - chatbots. To start with, a 
little information was asked about 
how did they usually plan their trav- 
els. The interview continued with the 


description of participant’s everyday 
technology use as well as the knowl- 
edge of and relationship with conver- 
sational interfaces in general, such as 
Siri. Finally, the participant was lead 
to the core topic of chatbots and the 
previous usage as well as experiences 
was examined. 


After the introduction, the usability 
session took place, whereas the user 
was given a task to search for their 
next trip’s flights with “Eddy Travels” 
chatbot that they had heard about, 
from a friend. The given task was 
rather broad to allow the user to ex- 
plore around, not restrict the inves- 
tigation of other functionalities (such 
as looking for a hotel or inquiring an 
insurance) and not to influence the 
overall experience. The main purpose 
of the task was, as mentioned, to allow 
the participant to have a fresh experi- 
ence with a chatbot to express oneself 
more broadly in the consecutive, fun- 
damental part. 


TOPIC SPECIFIC SESSION 


Followingly to the introduction and 
a brief hands-on usability session, 
the interview aimed to address the 
issues that helped to find answers to 
the main research question. Since the 
objective of the study was to discov- 


er the overall perceptions and con- 
cerns about pragmatic shortcomings 
chatbots, 
the open-ended questions in the 


in communication with 
semi-structured interview were 
guided through pragmatic theories 
acquainted in the theoretical part 
of the current work. Similarly, the 
questions were divided as discussion 
points about cooperation, behavior 
and conversational style. 

What is since the current 
work addresses the human-com- 


more, 


puter interaction on the grounds of 
human-human communication, it is 
interesting to see that the absence 
or weakness of pragmatic skills in 
human beings is detected as autism. 
Thus, some of the 

open-ended 

questions in the 

distributed topics 

were additionally 

inspired by American Speech-Lan- 
guage-Hearing Association’s “Social 
Communication Skills — The Prag- 
matics Checklist” (Goberis 1999) that 
helps the parents to detect the symp- 
toms of autism in their kids. 


As stated, the interviews conducted 
were semi-structured, thus the facil- 
itator took the questions prepared as 
an interview guide and applied ver- 


sions coming from the orientation 
and the participant of the ongoing 
study. Although, it was important to 
receive answers to all of the substan- 
tial matters to enable final analysis. 


COOPERATION 
First, as seen in the theoretical part, 
one of the initiators of the field of 
pragmatics, Paul Grice, stated the 
Cooperative Principle, saying: “Make 
your conversational contribution such 
as is required, at the stage at which it 
occurs, by the accepted purpose or di- 
rection of the talk exchange in which 
you are engaged.” (Grice 1975, p. 45). 
What is more, in order to fulfill the 
principle, Grice defined 4 maxims: 
quantity, quality, relation and man- 
ner. Hall (2018), 
the author of 
“Conversation- 
al Design”, saw 
these as powerful 
guides in order to create more hu- 
man-centered interactions and addi- 
tionally brought out what happens if 
these maxims are violated (Figure 4.1). 


Similarly, the current study drew on 
the above-mentioned maxims to de- 
fine questions about understanding 
the proactiveness and its necessity to 
the user. This section’s questions are 
illustrated in Table 4.1. 
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THE MAXIM OF QUANTITY 


Where is the closest 


place to get a cup of coffee? 


Pretty close 


THE MAXIM OF RELATION 


Where is the closest 
place to get a cup of coffee? 


I'm a tea drinker myself. 
Coffee is really hard 
on the stomach. 


THE MAXIM OF MANNER 


Where is the closest 
place to get a cup of coffee? 


Real close. It's The Old 
Coffee Mill, been around 
since the 1970’s. And, uh, 


THE MAXIM OF QUALITY 


Where is the closest 
place to get a cup of coffee? 


There is a Starbucks * 
on the next block. 


*not actually the closest, but | 
don't like the guy who runs 
the shop next door. 


BEHAVIOR 


To dig deeper into the pragmatic lay- 
er and address other parameters, the 
study aimed to enquire about the be- 
havior of the chatbot. To do so, two 
other theories from the theoretical 
framework were considered. 


First, Watzlawick, Beavin and Jack- 
son (1967) addressed the issue with 
behavior, stating that “all behavior is 
communication” (p. 22) and brought 4 
additional axioms, about relationship 
and verbal-nonverbal communica- 
tion for example, that define the suc- 
cess of communication. 


Similarly, Leech saw another be- 
havioral aspect of successful human 


let's see here...IUs in this 
terrific building with a tin 
ceiling and stained glass 
windows, real old 
windows...nice, nice 
windows...good light comes 
in. Its a very nice place...I 
can tell you how to get 
there because it’s right 
across the street from 
where I buy cat food for my 
incontinent cat. 


communication - politeness. He de- 
fined 7 maxims and differently from 
the Gricean ones, the politeness 
maxims add more personal value to 
the communication, they are seen as 
more natural and are overall believed 
to describe the behavior of the com- 
municator (En, Lan 2012). 


Coming from these theories, follow- 
ing questions in Table 4.2 were con- 
sidered in the interview. 


CONVERSATIONAL STYLE 

Finally, the overall conversation- 
al style was discussed to understand 
how the participants perceived the 
utterances’ styles and if the chatbot 


meets users’ expectations similarly 
among various cultures. 


Since Tannen (2005) found that any- 
thing said, is said in style - ata certain 
rate, pitch and amplitude, with par- 
ticular intonation, at a precise point 
in an interaction - it was found as an 
important point to the current study. 
As she suggested, successful com- 
munication among people is highly 
dependent on the matching of these 
devices. 


Table 4.3 illustrates the main ques- 
tions asked concerning conversation- 
al style. 


COOL DOWN SESSION 


To finish the interview and indicate 
the ending of it, some closing ques- 
tions were asked. 


In general, it was requested to rate 
which one of the discussed parame- 
ters (cooperation, behavior, and con- 
versational style) were appreciated 
the most and which the users per- 
ceived as weak. 


What is more, the participant de- 
scribed the negotiation with the 
chatbot, if they came to a mutual un- 
derstanding or they considered the 


communication failed? Finally, the 
users were asked if they would use the 
chatbot again. 


THE PARTICIPANTS 


In total, 15 participants were inter- 
viewed, 10 of them women, and 5 men. 
Coming from time as well as resource 
restrictions, non-probability sam- 
pling method was used - meaning, not 
every member of the population had a 
chance to be chosen (Non-Probability 
Sampling n.d.). Since the research it- 
self was qualitative and aimed to de- 
velop an initial understanding of the 
problem, the chosen method proved 
appropriate. However, it needs to be 
emphasized that statistical assump- 
tions about the whole population can- 
not be drawn (McCombes 2019) using 
non-probability sampling, in contrast 
to probability sampling. 


Conversational interfaces are seen as 
means to make technology and infor- 
mation accessible as well as usable for 
everyone - chatbots are equally desir- 
able for ages 18-34 and 55+ (Drift 2018). 
Therefore, not only young tech-savvy 
users but also older people with low- 
er technological competencies would 
have been suitable participants for 
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WHAT DO YOU THINK ABOUT THE 
RELEVANCE OF THE MESSAGES? 


EXPLAIN THE APPROPRIATENESS 
OF THE MESSAGES? ARE THE 
STATEMENTS RELATED TO THE 
TOPIC? 


WHAT WOULD YOU SAY 

ABOUT THE HELPFULNESS AND 
COOPERATION/PROACTIVITY OF 
THE CHATBOT? 


HOW WOULD YOU COMMENT 
THE EFFORT COMING FROM THE 
PARTIES? DESCRIBE THE INITIATIVE 


OF THE CHATBOT. 
HOW ABOUT THE CLARITY OF THE 


WHAT ABOUT THE CHATBOT'S MESSAGES? 

ABILITY TO KEEP THE 

CONVERSATION GOING? IN TERMS EXPLAIN THE UNDERSTANDABILITY 

OF MISUNDERSTANDINGS? OF THE STATEMENTS. DO THEY 
MAKE SENSE? WHAT DO YOU 


THINK ABOUT THE ORDER? 


WHAT WOULD YOU SAY 
ABOUT THE ENDING OF THE 
CONVERSATION? (DOES IT FEEL 
LIKE IT “WALKS AWAY"?) 


DESCRIBE THE AMOUNT OF THE 
INFORMATION PROVIDED (TOO 
MUCH, TOO LITTLE, SUFFICIENT). 


TABLE 4.1_ IN-DEPTH INTERVIEW: COOPERATION 


WHAT DO YOU THINK ABOUT 
THE LENGTH OF THE CHATBOT'S 
STATEMENTS? 


WOULD YOU SAY THE CHATBOT 
WAS TOO INFORMATIVE OR 
RATHER NOT ENOUGH? 


HOW WOULD YOU DESCRIBE THE 
QUALITY OF THE MESSAGES? 


WHAT MAKES THE MESSAGE TRUE 
OR QUALITATIVE FOR YOU? 


WHAT WOULD YOU SAY ABOUT 
THE CLARIFICATION PROCESS 
IF THE CONVERSATION GOES 
“WRONG"? 


TABLE 4.2_ IN-DEPTH INTERVIEW: BEHAVIOR 


HOW WOULD YOU COMMENT THE 
ATTITUDE AND BEHAVIOR OF THE 
CHATBOT? 


EXPLAIN THE RELATIONSHIP WITH 
THE CHATBOT. IS IT LIKE TALKING 
TO A FRIEND OR RATHER NO? 


HOW WOULD YOU DESCRIBE THE 
EVOLUTION OF THE CONNECTION? 
IS THERE ANY AT ALL? 


DO YOU PERCEIVE INACTIVITY 
AT SOME POINTS? DOES IT 
CARRY ANY MEANING TO THE 
COMMUNICATION? 


WHAT WOULD YOU SAY ABOUT 
NON-VERBAL COMMUNICATION IN 
THIS CASE? 


HOW DID YOU PERCEIVE THE 
POLITENESS OF THE CHATBOT? IS 
IT IMPORTANT? 


WHAT WOULD YOU SAY ABOUT 
THE AUTHENTICITY, NATURALITY 
OF THE CHATBOT? 


TABLE 4.3_ IN-DEPTH INTERVIEW : 
CONVERSATIONAL STYLE 


HOW WOULD YOU DESCRIBE THE 
CHATBOT'S CONVERSATIONAL 
STYLE? DOES IT REMIND YOU OF 
SOMEBODY IN REAL LIFE? 


DESCRIBE THE CHATBOT'S USE 
OF WORDS. (GRAMMATICAL - 
FORMAL, RATHER EVERYDAY TALK 
- CASUAL) 


HOW WOULD YOU COMMENT ON 
THE APPROPRIATENESS OF THE 
LANGUAGE? 


EXPLAIN HOW THE CHATBOT 
CHANGES ITS REACTIONS AND 
ENTHUSIASM THROUGHOUT THE 
CONVERSATION? 


WHAT WOULD YOU SAY ABOUT 
THE CHATBOT BEING FUNNY OR 
SERIOUS? 
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the study. 


Nevertheless, including older and less 
technologically competent partici- 
pants was unfortunately not feasible, 
since the tools 

used implied 

the knowledge 

of English lan- 

guage. Thus, 

the population 

studied can be seen as rather fre- 
quent technology users - all of them 
asserted using technology, particu- 
larly smartphone and laptop/comput- 
er, throughout the whole day. How- 
ever, the author of the current work 
aimed to include participants with 
diverse IT and technology compe- 
tences - such as high- and mid-lev- 
el. The skills were estimated by the 
author prior to the study, hence they 
did not carry an actual objective. Yet, 
itis believed that operating according 
to mentioned structure and engaging 
different participants, resulted in ad- 
ditional multifaceted outcomes. 


As mentioned, the participants were 
chosen according to anticipation 
about their technological competen- 
cies and diverse backgrounds, initial- 
ly aimed by the researcher, in order 
to collect versatile results. Therefore, 
the technique used for non-proba- 


bility sampling method was purpo- 
sive. Purposive sampling occurs when 
the researcher relies on his/her own 
intuition while choosing the par- 
ticipants (Purposive Sampling n.d.). 
Furthermore, 
coming from 
the drawbacks 
of non-proba- 
bility sampling 
and to increase 
the reliability of research findings, 
heterogeneous or maximum variation 
sampling was used. It aimed to pro- 
vide maximum variability within the 
results, thus, as already mentioned, 
the participants chosen had diverse 
characteristics within their technolo- 
gy use as well as general background. 
Given the above, the participants were 
mostly acquaintances or friends of 
the current work’s author, hence, it is 
believed that the participants adjust- 
ed to the interview faster, as well as 
felt more comfortable, than it would 
have been in the case of random sam- 
pling, for example. 


The participants were mostly mil- 
lennials, therefore the age range was 
from 25-42 years, with a mean age of 
28,2 years. The occupations varied 
from university students to diverse 
professions. Not all of the participants 
had had a prior experience with chat- 


CODE 


Pai 


P2 


P3 


P4 


AGE SEX OCCUPATION 


33 


27 


26 


25 


F 


F 


F 


IT Analyst 


Design Student 


Design Student 


Event 
Executive 


Economics 
Student 


TECH 
COMPETENCE 


Works in IT, uses 

laptop throughout the 
whole day, especially 

on working hours. On 
smartphone manages 
mostly emails and other 
communication. 


Is interested in 
technology connected 
with her interests 
(combining art and 
technology). Uses 

every day quite a lot, 
smartphone around 2 
hours and computer 6-7 
hours a day. 


Coming from the 
background, needs to 
be aware of and try out 
new currents, especially 
in her field of interest. 
Uses technology all day 
long - ca 3 hours on the 
phone, 7-8 hours on the 
computer. 


Considers herself 
rather tech-savvy and 
quick adapter. Finds 
technology engaging. 
Uses full days at work, 
therefore tries to 

use less for personal 
matters. 


Finds herself being 

on good terms with 
technology. Coming 
from previous work 
experience and general 
interests, actively 
follows technology 
news - not only about 
consumer technology, 
but also science and 
B2B. Listens to podcasts 
on technological 
innovations etc. 


EXPERIENCE 
WITH CHATBOTS 


Has tried to build one 
herself. Usually avoids 
them as she knows that 
these are programmed 
to answer some specific 
questions. Rather relies 
on her own capabilities. 


Has prior experience, 
but says that: “/.../ if 

I have to, I’m writing 
there, of course.” 
Mentions a good prior 
experience, but prefers 
to talk with a “thinking 
human being”. 


Has used a couple of 
times - brings out good 
experience with a bank 
application. 


Has noticed these on 
many websites, but 
has used mostly for 
customer service. 

Has had some good 
experiences as well as 
bad ones. 


Has not really used 
chatbots, although has 
noticed these on various 
websites, for example. 
Does not consider 
chatbots adding much 
value. 


P6 


By 


P8 


Po 


P10 


Pigi 


31 


27 


M Design Student 
and Web- 
Designer 


M Purchasing 
Business 
Controller 


M Design Student 


F Cost Estimater 
and Purchase 
Manager 


M Design Student 


F Product 
Designer 


Is used to working 
with technology and 
mentions that he 
needs to be aware of 
it. Enjoys organizing 
everyday workflows 
with technology as 
well as trying out new 
solutions. Has a device 
in his hands throughout 
the whole day. 


Does not consider 
himself as the most 
advanced, but likes 

to keep up with the 
technology news. Uses 
computer throughout 
the working hours, 
therefore tries to use 
less in the evenings. 


Tends to implement 
technology in his daily 
life as much as possible, 
owns several devices 
and gadgets that he uses 
around 80% of the day. 


Considers the 
experience with 
technology “quite 
good”. Follows some 
technology news 
websites and stays 
updates through co- 
workers. 


Manages technology 
properly, but due 

to current budget, 
cannot afford the latest 
technology. Keeps up 
with technology news 
regularly and uses it all 
day, everyday. 


Very passionate about 
technology and coming 
from the profession, 
even more so. States 
that she uses too much 
technology, not only 

at work, but also in 
personal life. 


Is aware of them, but 
has not used. 


Has started to notice 
them on websites 

and brings out a good 
experience as well as a 
bad one. 


Has used only for 
routine purposes, 

such as contacting 
telecommunication 
company. Prior 
experience has not been 
that good. 


Has had minor 
experience and 
mentions it being 
“weird”. 


Has had some 
experience and recalls 
it not that good. But also 
brings an example of a 
good one. 


Recalls using several 
ones, but since she has 
understood a maneuver 
for skipping the chatbot 
and getting straight 

to the human agent, 

she regularly uses the 
shortcut. 


P12 28 M Business 
Intelligence 
Consultant 

P13 34 F Purchase 
Manager 

P14 25 F Auditor 

P15 42 F Controller 


bots and the ones who did, generally 
commented on the experience as not 
enjoyable. For a more thorough over- 
view and smoother discussions in the 
upcoming chapters, all of the study’s 
participants are illustrated in Table 
4.4. 


While recruiting, the participants 


Uses technology on a 
daily basis and says 

“it’s always there” since 
he also works in the IT 
field. Nevertheless, does 
not consider himself 
keen on technology. 


Relationship with 
technology is medium, 
or alittle less. Yet, she 
manages all of the 
everyday things. Does 
not really follow tech- 
news. Uses technology 
throughout the day, 
for work and private 
matters. 


Also considers herself 
as medium user, not 
very professional. Since 
she works with laptop, 
technology is almost 
always there, around 
70-80% of the day. For 
private matters, she 
uses it mostly as a tool 
of communication. 


Says that she is not very 
tech-savvy and uses 
mostly smartphone for 
everyday things. 


Mentions rather the 
ones to call with, not 
text-based chatbots. 


Has encountered these 
in web stores, but never 
really used one. 


Mentions the chatbot 
on Ryanair website, but 
has not had any good 
experience thus far. 


Has encountered some 
on companies’ websites, 
but rather the ones with 
human agents. Does not 
have prior experience 
with chatbots as such. 


were briefly informed about the topic 
of the interview, as well as their rights 
were listed. It was ensured that prior 
knowledge of the field or any specific 
skills were not important to partic- 
ipate in the study. Thus, that mini- 
mized the risk for an unsuccessful 
interview and helped to encourage 
participation. 
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THE CHATBOT 


In order to help users draw opinions 
straight from a mutual experience 
and help to facilitate the interview, an 
existing chatbot was used. The chat- 
bot employed, is called “Eddy Travels” 
(Figure 4.2) and the primary goal is to 
help users find plane tickets. Addi- 
tionally, the chatbot offers support 
in discovering hotels, searching for a 
restaurant or booking an insurance. 
“Eddy Travels” is accessible through 
various instant messaging platforms 
and is powered by Skyscanner, a well- 
known online travel agency. 


First, the reason for choosing a chat- 
bot operating on the instant messag- 
ing platform, is foremost for the fact, 
as described in 

the theoretical 

part, these plat- 

forms are highly 

popular among 

various users. For the current study, 
the participants were initially guided 
to use the chatbot through Facebook 
Messenger, since all the participants 
had an account and a possibility to 
access the chatbot via Facebook. What 
is more, the high number of chatbots 
on this specific platform, shows the 
popularity among developers as well. 
Facebook aims to become a network 


where people can achieve everything 
(such as order food, ask for a taxi, etc) 
and their ever-growing amount of 
monthly users, illustrated on Figure 
4.3 (Clement 2019a), is firmly support- 
ing these predictions. Thus, it was 
seen as an appropriate facilitation 
platform for the study. 


However, during the in-depth inter- 
views, it became obvious that many of 
the participants do not use Facebook 
Messenger that much anymore and 
prefer other instant messaging appli- 
cations such as Whatsapp or Telegram. 
Therefore, the task was modified like- 
wise and it was not mandatory to use 
Facebook to interact with the chatbot. 
It is important to note, however, that 
some user interface elements dif- 
fer among these 
platforms, for 
example, carou- 
sel is not used 
on Whatsapp and 
Telegram. Yet, as the study did not 
aim to evaluate the usability, it was 
not seen as a harmful effect for the 
results. 


Second, as it came out from the re- 
search conducted by Brandtzaeg and 
Følstad (2017), the main rationale for 
using chatbots is productivity. There- 
fore, it was seen as a crucial variable 


3 000 
2500 
2 000 


1500 


for the current study and “Eddy Trav- 
els” a suitable medium. Additional- 
ly, as the modern world’s people are 
travelling more and more, the topic 
was seen as fitting for all the partic- 
ipants - hence the choice in the cate- 
gory of travelling. 


What is more, according to botlist.co, 
a third party database that displays 
bots currently available on several 
platforms, the chosen chatbot ranks 
4th in the overall list of chatbots on 
Facebook Messenger and the ıst for 
the travelling category, as of Novem- 
ber 2019, after being on the market for 
nearly a year. Thus, it is believed that 
in general the designers of this chat- 
bot have done solid work and have 
made the right choices that please the 


users. Itis worth mentioning that only 
one chatbot was used in the current 
study, to not create comparison while 
using several chatbots, since that was 
not the aim of the study. 


Finally, in terms of the interaction, 
“Eddy Travels” supports both, quick 
replies as well as natural language in- 
puts. While most of the chatbots on 
instant messaging platforms at the 
moment are operating only through 
quick replies, the possibility to use 
both is an additional benefit for using 
the mentioned chatbot. 


Thus, coming from the reasons listed, 
“Eddy Travels” was seen as an appro- 
priate chatbot to support the study. 
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poY Eddy Travels 


Hi Sandra! 


Chat with the Eddy Travels Al assistant and discover 
the best flight deals in seconds % 


Click “Get Started" to begin! LI 


Get Started 


Eddy Travels 
/ € 


Eddy Travels 


4.8K people like this 


Get Started 


“Flights, Toronto to 
New York in July” 


Click t 
ant ti 


Find the best flights! Use y 


#9 Hi! I'm Eddy, your personal Al 
travel assistant. 


#% Just say something like 
"Flights from Toronto to New York 


A in July" 


X. Search Flights ‘+ Take Me Anywhere 


09:07 


5 A Eddy Travels 
Ju e 


$ Hi! l'm Eddy, your personal Al 
travel assistant. 


% Just say something like 
"Flights from Toronto to New York 
in July" 


Milan to Berlin 


When do you want to fly? Say 
dates like: "May 15 - 25" 


December 19-26 


® Searching for flights from 
Milan to Berlin on Dec 19 with 
return on Dec 26 


Z & I'm looking for the best 
prices now and will be back in a 
moment! 


Chie 


09:09 


a A Eddy Travels 


LIVUIU 790 myms, nere are une 


A best options: 


Milan to Berlin €78 
> Thu 

€ Thu 

Ad 


View Flight Details 


| can also track prices of these 
flights, look for hotels in Berlin, or 
find you a worldwide travel 
insurance. 


3 Price Alert 


Thanks for requesting price alerts! 
| will start looking for cheaper 
options straight away. Please 
enter your email | could follow up 
with you later on: 


your.mail@mail.com 
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DOCUMENTATION AND 
DATA ANALYSIS 


As mentioned, the data was collected 
through 15 remote interview sessions 
via Skype, with the average duration 
of 50 minutes. However, coming from 
the nature of the interviewees, the 
timespan ranged from 35 minutes to 
1 hour and 7 minutes, the shortest be- 
ing the pilot study. As mentioned, af- 
ter the pilot study, the questions were 
adjusted as well as clarifications were 
added. After completing all the in- 
depth interviews, deep analysis pro- 
ceeded. 


Coming from the qualitative method 
and in-depth interviews that aimed 
to explore profound effects, as well 
as participants’ thoughts and impres- 
sions on the experience of using a 
chatbot, the data was analysed using 
thematic method. Braun and Clarke 
(2006) define thematic analysis as: 
“[...| a method for identifying, analys- 
ing, and reporting patterns (themes) 
within data.” (p. 79). Or to go more in 
detail, Norman Nielsen Group’s web- 
site defines it as: “Thematic analysis is 
a systematic method of breaking down 
and organizing rich data from quali- 
tative research by tagging individual 
observations and quotations with ap- 
propriate codes, to facilitate the dis- 


covery of significant themes.” (Rosala 
20192). 


Thematic analysis is one of the most 
common methods for analysing 
semi-structured interviews and its 
main benefit relies on the flexibility 

- it can be used for explorative 
studies, where the patterns are 
not clear prior to the interviews 
and also for more deductive 
studies, where it is more 
apparent what the researcher 
is looking for (Mortensen 2019). 


In the current work, some patterns 
were already foreseeable before the 
study, as the interview questions were 
conducted using pragmatic theories, 
however, it was important to keep an 
open mindset and allow new patterns 
to evolve directly from participants’ 
insights. Since the current work fo- 
cused on bringing clarity to the per- 
ception of pragmatic aspects and the 
overall experience, the aim was not to 
generate fixed theory as would have 
been the case with grounded theo- 
ry analysis. Also, as the objective was 
to produce qualitative, descriptive 
outcome and there was no need to 
quantify the data in any way, thematic 
analysis was seen in favor of content 
analysis (Vaismoradi, Turunen et al. 
2013). 


The following chapter will give a 
thorough overview of how thematic 
analysis was conducted and the re- 
sults drawn, but before going into de- 
tail, it is crucial to go over the main 
steps that were taken. These phases 
are first and foremost guidelines, not 
rules, and it is important to adjust the 
instructions to the research in hand 
(Braun, Clarke 2006, p. 87): 
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, Resul_ 
ts 


In order to answer the posed research 
question - 


codes were re-named, others disap- 
peared or, coming from the relation- 


How do users perceive the pragmatic shortcomings in 


communication with chatbots? 


- and assure the reliability of the re- 
sults, it was crucial to follow a sys- 
tematic approach. Therefore, as men- 
tioned, thematic analysis method was 
used. To facilitate a profound study, 
the author of the current work first 
transcribed all the interviews from 
the recordings. It was seen as a valu- 
able point for the researcher, since it 
allowed to start familiarizing with the 
data. 


ANALYSING DATA 


The analysis continued with the help 
of NVivo, a qualitative data analy- 
sis software. First, all the interviews 
were read and re-read, whereas valu- 
able quotes and phrases were high- 
lighted and given preliminary labels 
(Figure 5.1). 


As a next step, all of the labels were 
analysed, similar ones joined and 
the combined groups were given a 
code. Again, the codes and corre- 
sponding labels were re-investigat- 
ed - during the process, some of the 


ships between one another, merged 
once again. Finally, themes started to 
emerge (Figure 5.2). 


To define the themes, it was crucial to 
keep in mind the research question, 
as the aim was to find an answer to 
it. For a more thorough overview and 
to foster recognizing significant pat- 
terns, the author took a break to come 
back to the codes and themes with a 
fresh mind (Rosala 2019a) and settle 
the final themes. 


DEFINING THE THEMES 


Coming from the method of analy- 
sis and the objective to describe the 
themes that were apparent already 
before the study, as well as to discov- 
er new patterns, the results illustrate 
five definite themes (Table 5.1). The in- 
depth interviews directly addressed 
cooperation, behavior and conversa- 
tional style, since these are the topics 
deeply described in the field of prag- 
matics. However, two other pragmat- 
ic aspects by Hymes - ends and so- 
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[00:07:37] Yeah. Just... You can take it according to your preferences, let's say. 
[00:09:39] | just open it then... It seems it doesn't want to start the conversation with me. 


[00:10:02] You can think loud, what do you think of that experience? 


Go to gate. 


It offers me like... Yeah. Uh, | think | could find something from here. 


[00:14:20] All right. OK. Would you... What does it like suggest you to do more? Would you 


use something more? 


[00:14:30] OK. 


Yeah. | think | could even ti 
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@ Usual booking of travel 
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that, I don't know... The destination or "Good pick!" or something like that, you know. 
Would have put some more emotions into it. Yeah. But I don't know. Maybe a good 
sentence about the destination or something like that or... 


Files\\P02 
2 references coded, 0.63% coverage 


Reference 1: 0.48% coverage 
It's the normal sentences without any emotion. So you can't... There is no emotion. You 
can't evaluate, I think, if it's for life or not, because these are not emotions. 

Reference 2: 0.15% coverage 
No. There is no emotion. There is really no emotion. 


Files\\P03 
1 reference coded, 0.78% coverage 


Reference 1: 0.78% coverage 
Yeah, but with the tone of voice, communication way, it was like... In a way it was nice 
with emojis and tone of voice was OK. It's not so... It's not including, for me like... humor 
that much, except one part. So it was, it was fine. Didn't make me crazy or super funny or 
super happy. Or super sad... I'm super in the middle. 


@ CODES > fi) Nodes > @ Conversational style > @ Emotions 


cio-cultural rules - emerged from the 
interviews and were seen as equally 
important answering the research 


question. 


THEME 


Cooperation 


Ends 


Behavior 


Conversational 
Style 


Socio-Cultural 
Rules 


To be more clear, the data analysis 
is illustrated on Alluvial Diagram in 
Figure 5.3. In the remainder of the 


paragraph, all five themes will be ad- 


dressed in detail. 


DESCRIPTION 


The topic concerns chatbot’s proactivity in 
general, how the conversation gets started 
and how it proceeds. Also, all of the Gricean 
cooperational elements - quantity, quality, 
relevance and manner - were addressed. 


The current theme regards the overall value of the 
chatbot, when the users feel the communication 
failing, when they see it succeeding. What is more, 
it illustrates how the users perceive chatbot in the 
Web environment. Coming from Hymes’ theory, it 
is a theme of purposes, goals and outcomes. 


Since all behavior is communication, as stated in 
the literature review, different aspects of chatbot’s 
behavior are listed. Such as politeness, non-verbal 
communication, humanness, etc. 


The theme concerns with Tannen’s approach of 
how things are said. Meaning, the use of words, 
emotions, and speed, to name a few, are analysed. 


Last but not least, current topic addresses an 
issue, or according to Hymes a norm/standard, 
that is critical for today’s users: security and how 
the data will be used. 
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COOPERATION - WORKING 
TOGETHER WITH THE USER 


The most frequently mentioned theme 
throughout all 15 interviews, was the 
matter of cooperation. The various 
sub-topics that were mentioned un- 
der this theme were: collaboration in 
general, manner, quantity, relevance 
and quality - as illustrated on Figure 
5.4. To better understand the results, 
an overview of the sub-topics is given. 


COLLABORATION - BEING WELCOMING 
AND PROACTIVE 


Current sub-topic concerns collabo- 
ration in general (Figure 5.5), how the 


users perceived the initiative coming 
from both parties, themselves as well 
as the chatbot. 


To start with, since the first four par- 
ticipants were asked to interact on 
Facebook’s platform, the users start- 
ed straight from social media. It was 
hard to understand how they should 
start and they wandered around the 
Facebook feed for a while. Although, 
not much changed when the partici- 
pants were free to explore the chatbot 
through Google and the official web- 
site (eddytravels.com). One was won- 
dering if a link in the Facebook feed 
should be clicked, others stated: 


COOPERATION 


RELEVANCE 


COLLABORATION 


WILLINGNESS TO 
OPENLY WRITE 


STARTING TO 
CHAT 


ADDITIONAL 
SERVICES 


UNDERSTANDING 
FUNGTIONALITY 


QUALITY 


MANNER 


UNDERSTANDING 
SENTENCES 


ORDER 
con Ma (POSITIVE) 
QUESTIONS 


CLARIFICATION CER 


LEADING 
SENTENCES 


CONTEXT 
ORDER 


(NEGATIVE) 


OPTIONS 
PROVIDED 


LENGTH 


SKIM THE 
TEXT 
QUANTITY 


UNDERSTANDING 


“So should I send them a mes- 


sage? No... The thing is, I cannot 
understand how it works.” (P3) 

e “[...] I think it is confusing, the 
website. I... Like, for example, 
here, I don’t really understand, 
does it want me to go to like 
click here (the different IM plat- 
form’s links) or does it want me 
to, like, click here (the section 
down, with different options)?” 
Adding later: “I feel like they 
weren't very clear about what... 
That they are a chatbot and what 
it does. If you go on the Website, 
then it just says it’s an AI travel 
assistant...” (P5) 


What is more, participants were also 
doubting if they should start the 
conversation themselves. P1 and P12 
stated that they were expecting the 
chatbot to start the conversation. P5 
described: 

e “I just open it then... It seems it 
doesn’t want to start the con- 
versation with me.” (P1) 

e “Like here I had to say some- 
thing myself first before they 
said something. I feel it could 
have been more clear if they 
had an opening line... Like Hi... 
it came only after I said some- 
thing.” (P5) 

e “I guess I should start the con- 


COLLABORATION 


WILLINGNESS TO 


OPENLY WRITE 
STARTING TO 
CHAT 
FOLLOW-UP 
ADDITIONAL QUESTIONS 
SERVICES 
UNDERSTANDING 
FUNCTIONALITY LEADING 
SENTENCES 


versation..” (P12) 

After opening the chat and getting 
the first message from the chatbot, 
users mostly understood what they 
can do with the chatbot. P5, P6 and 
P14 claimed that even though the 
chatbot did not explain how to use it, 
they had no hard time understanding 
what they can do with it. At first, P15 
did not understand what AI stood for 
and pronounced it as al. However, one 
participant stated: 

e “But there was no that much in- 
formation...Like, how can I say? 
Meeting point... Let’s say, he 
just says the: “Hi, I’m Eddy, your 
personal AI assistant.” Yeah. 
But in which sense? Like how 
can you help me? Maybe if you 
gave me a bit more information 
about yourself, to trust you, I 
mean. And to understand your 
ability or capability.” (P3) 
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Followingly, users noticed that the 
chatbot was trying to 

push them to write in 

a way that is under- 

standable for it. P12 points out doing 
exactly what the chatbot told him to 
do. Starting a new search, P7 stated 
that he did not remember how he was 
supposed to write and scrolled back 
in order to do it correctly. Also, Po de- 
leted part of the utterance after writ- 
ing it, to type it exactly how the chat- 
bot had suggested, even adding the 
spaces the same way for “December 
26 - January 7”. P1 was confused if she 
could look for a longer travelling pe- 
riod and similarly P14 doubted if she 
should know the exact date, since the 
leading examples were relatively stat- 
ing only one (“Say dates like: May 15 - 
25”) or the other (“Just say something 
like flights from Toronto to New York 
in July”). Overall, the participants had 
opposing thoughts about the leading 
utterances: 

e “So “Just say something like 
flights from Toronto to New 
York.” This manipulates me 
pretty well. I write what he ex- 
actly wants me to write, as a 
phrase.” (P2) 

e “At the beginning I felt a bit 
like... yeah, but why you are 
leading me? But then I saw in 
the second section actually it’s 


like better to lead me, because 
otherwise if it’s not 
understanding me, 
it’s a bit like making 
me mad about it.” (P3) 
“And I like how they tell you, 
like examples of what to say. 
So you kind of... Because, you 
know that it’s a bot. So then it 
just gives you kind of an under- 
standing of what the bot will 
understand when you write. 
Which will help you out... Like 
if you start writing something 
really long or crazy, then you al- 
ready... Your expectations have 
been managed, you know, like 
that you need to keep it simple 
and so on.” Although, after en- 
countering an error, the par- 
ticipant noted: “[...] I thought I 
understood the way it wants me 
to write.” (P4) 
“At the same time, it wasn’t that 
difficult to get what I was trying 
to ask. I mean, I follow the ex- 
ample. I can imagine that there 
are like a hundred-millions dif- 
ferent kind of ways to search 
for the same kind of results. 
Even just typing LON to MIL..or 
something like that is very dif- 
ferent from writ...typing down 
a sentence that is that specific 
and I did it just because it was 


suggesting me to do that. So 
even that is not that natural as 
if Pm checking with a person.” 
(P11) 


Vast majority of the participants 
were mentioning the lack of in-depth 
questions. Meaning, they did not 
mind when the chatbot was providing 
additional services and were rather 
expecting it, but the chatbot stayed 
very superficial and did not bother to 
ask the users to further understand 
their needs to find a fitting flight. P6 
simply expected the chatbot to ask for 
feedback. Whereas some other par- 
ticipants commented in more detail: 
e “[...]) what I would like to have 
is some kind of suggestions 
maybe that, you know: “Are the 
travel dates flexible? I found 
like X amount cheaper tickets if 
you would travel...” like I don’t 
know.... For example, either 
from other airport.. Like near 
airports... Or some other dates 
or something.” I don’t know 
maybe some proactive conver- 
sation or suggestions.” (P1) 
e “[...] if the price was high... 
Would it be able to ask me: 
“Do you mind not between 20 
and 25, but 21 and 25 or 26” So 
it could be more like... Since 
you're there to help me. Maybe 
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you can ask like this... Or like: 
“Do you have any other dates 
that I can help you to check? Is 
it good for you?” like after the 
action, instead of telling to me 
that I can also track prices of 
these flights or find the world- 
wide travel insurance. Maybe I... 
I was expecting like: “Is it fine 
for you? Or do you have any, you 
know, any other dates to check? 
What can I do for you more?”” 
(P3) 

“I feel like it would have been 
maybe a bit more useful if it’s 
like, “oh, how do you find these 
options?” And then like asks you 
more details, for example, like 
“which of these options do you 
like the most?” Or like, “do you 
want to look at other things? 
Maybe some other days, or 
some other locations...”” (P5) 

“I would expect him to be like 
“Did you find what you were 
looking for? Do you want to set, 
to change dates? Do you want to 
look for cheaper flights in sim- 
ilar dates? Do you want to put 
the maximum... Do you want to 
look for flights that only have 
no stops or just one stop?” [...| 
it just shows me the flights and 
then it says, “OK, that's it. You 
can look for another flight”. It 


66 49Vd 


PAGE 100 


didn’t really care if I found it or 
not.” (P12) 


What is more, when the users did not 
answer anything to the chatbot, it of- 
ten stayed inactive itself. P5 and Pio 
claimed that at one point the chatbot 
did not do anything and Pio adds that 
it was like being like a situation when 
people are chatting and not knowing 
what to say, therefore simply clos- 
ing the conversation. P13 felt that the 
chatbot had left since she did not use 
the microphone to talk, as the chatbot 
suggested with the previous message. 
Some other participants commented 
on it followingly: 

e “[...] it asked me like “what's 
your check-out date?” and then 
that's it. The conversation end- 
ed. It didn’t ask me like “Hi, I’m 
still here for your... Did you 

get confused? I can help you.” 
To push me a bit like to inter- 
act with the service..but, I think 
that the conversation ended up. 
It’s been 15 minutes and I’m not 
saying anything. |... If I say... 
Communication failed because 
of the last step, because it just 
stopped. So I don’t know what 
happened.” (P3) 

e “And then also here it sudden- 
ly stopped to talk. You know, I 
had to wake him up again. [...] I 


don’t expect you to just hang on 
and say nothing until I say ev- 
erything again. If there is some- 
thing you don’t understand, if 
I wrote instead of clicking. OK, 
tell me “please click” or, you 
know, say something, but don’t 
just be there waiting for some- 
thing.” (P12) 

e “I haven't answered or replied 
to this text that he texted me. So 
maybe some time later he could 
write me that “Hello. What did 
you mean with this?”” But add- 
ing: “Someone might be like, oh, 
it doesn’t communicate to me 
anymore. Like, I don’t want to 
do this anymore. I will rather 
go to a website. But then again... 
Someone would feel like frus- 
trated that... What do you want 
from me? I’m still just think- 
ing... so yeah, it could be like 
two ways.” (P14) 


The final thought, the fact that some- 
one might feel overwhelmed if the 
chatbot is too pushy, lingered from 
several other participants’ thoughts. 
Po said that the chatbot was very ac- 
tive and others added: 

e “There is no ending to the con- 
versation. I mean, even if Pm 
satisfied with what I learned, 
[the chatbot] is keeping prompt- 


ing me suggestions, what I can 
do next, what I can do next, 
what I can do next.” (P6) 

e “I think it’s not ended at all. Be- 
cause, I feel that it is still hang- 
ing there for me [...] but maybe 
I don’t want it to have a proper 
closure because I’m just asking 
a question if I want to have an 
answer.” (P8) 

e “I can see the effort in trying to 
make the conversation... Like 
keep going with the conver- 
sation, although. Why should 
I? [...| So the fact of having and 
keep going with the conversa- 
tion is very weird because im- 
mediately I have something that 
is pushing me outside.” (P11) 


As the latter thought indicates, most 
of the participants were not so willing 
to write with the chatbot, thus were 
not very collaborative themselves. 
Their answers were short, or even or- 
ders, like P6 noticed himself giving. 
And if they had additional questions 
or doubts, they were not initiative to 
openly write to the chatbot them- 
selves. The participants often had 
second thoughts about what would 
happen if they wrote, even doubting if 
they can write at all. For example, P15 
returned to the website hoping to be 
able to select a different function for 


searching restaurants and did not ad- 
dress the favor straight from the chat. 
Additionally, other thoughts that il- 
lustrate the participants’ mindsets in 
a precise way: 

e “I mean, I don’t know what 
would happen if I would say, 
like, “I need cheaper tickets”. 
Is it going to do something? [...| 
Also dollars [...| I don’t know a 
conversion rate to this. Can you 
change this? Can I say I don’t 
want dollars? Pounds... wait, 
let's try this...” (P4) 

e “I think like right now, I’m also 
kind of stuck.. Because basically 
I feel like |...] “Ah..maybe I don’t 
want to receive this email. So 
what should I do now?” Because 
the only option given is like my 
email. So Pm just trying to... 
Maybe I just regret, I don’t want 
your emails, but how can I do 
that without, you know, leaving 
the conversation.” (P10) 


MANNER - BEING CLEAR AND NEAT 


Current sub-topic goes further and 
concerns in more detail about the 
clarity of messages - if something 
was misunderstood or vague. Also, 
the brevity and order was addressed. 
Diverse subtopics are illustrated of 
Figure 5.6. 
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MANNER 


UNDERSTANDING 
SENTENCES 


ORDER 
(POSITIVE) 


ERROR 


UNDERSTANDING 
CONTEXT 


(NEGATIVE) 


In general, the participants had no 
hard time understanding what was 
the chatbot saying or what was it ex- 
pecting from them. They used the 
words “clear” and “straightforward” 
when they were asked about the clari- 
ty of the messages. P8 noted that even 
his mother, who does not trust tech- 
nology in general, would easily un- 
derstand what had been said. 

Still, the participants did encounter 
misunderstandings. Pio and P13 ini- 
tially misunderstood the welcoming 
carouselle that informed the chatbot’s 
functionalities and thought of it as an 
advertisement. P2 and P3 had prob- 
lems understanding what was wrong 
if they typed the departure point as 
“Milano” (not “Milan”, as is correct 
in English). As the chatbot answered 
“I could not find any airports around 


there. Try different city”. Hence, P2 
was wondering if there were no di- 
rect flights and changed the search 
to Rome, P3 typed Bergamo instead, 
saying that it was her fault. Some us- 
ers entered the destination as an is- 
land or archipelago, such as “Bali” or 
“Maldives”, yet the chatbot changed 
the name according to the official lo- 
cation where the airport was. Po did 
not mention it, yet scrolled back to 
look for the correct name “Denpasar” 
for the airport in Bali, to indicate it 
correctly the second time around. P1, 
however, commented on the misun- 
derstanding after the chatbot stated 
the destination as “Male”: 

e “OK, I’m not sure that it got my 
destination correct |...] I was 
thinking like Maldives, but... 
Let's see... Let's see where it 
takes me. Oh, seems it’s cor- 
rect. [...| The airport name was 
something different, so I was a 
bit confused at that, where is it 
taking me?” (P1) 


It is clear that several participants 
were confused by what is meant with 
“the best options”. They either did not 
notice the “cheapest” and “fastest” 
tags on the cards, as was the case for 
P12 and P13. Or did not understand 
what these tags stood for, as P11 was 
wondering if the tag “cheapest” stood 


for the whole section or one flight. 

Another user commented followingly: 

e “Well, best dates... Best op- 

tions... So I don’t know what 

that means, really [...|] Pm think- 

ing that maybe I missed it... Im 

looking for the best prices now. 

Yeah. So I guess it’s chooses the 

best prices. Yeah, I don’t know... 

The absolutely cheapest then, it 
must be.” (P15) 


Also, the users mostly appreciated 
that the chatbot gave the context of 
the talk with emojis, GIFs or actual- 
ly stating it with words. For example, 
if the chatbot wanted to know about 
travelling dates, it put an emoji of cal- 
endar or if it was searching for flights, 
it sent the text with an emoji as well as 
a GIF. It was clear to the participants 
and it ensured to them that the chat- 
bot was in the right direction. How- 
ever, drawbacks encountered when 
the chatbot had changed the top- 
ic, whereas the context for the user 
stayed the same: 

e “OK, but it didn’t understand 
I’m looking for Barcelona, so it 
changed directly the topic. OK, 
so maybe my expectation was 
like.. still I keep going. I didn’t 
close the channel...” (P2) 

e “Track prices... Please make 
your flight search, OK? So I have 


to do the search again. Flights 
what I search for. It’s not re- 
ally comfortable. [...] I would 
have preferred to have any way 
to reprompt the chatbot with 
like track prices about my last 
search, instead of being sug- 
gested to start all over again... 
what do you need? I felt like, OK, 
we were talking for the last five 
minutes. Now it’s like I have in 
front of me a complete new as- 
sistant that didn’t have any con- 
tact with me before” (P6) 

e “Iwas expecting it to, you know, 
actually follow the context. I 
mean, I want to go to Rome, 
from Abu Dhabi, on these dates. 
Okay, you showed me these 
flights. But now show me only 
the direct ones and it didn’t 
know what I was talking about.” 
(P12) 


What is more, when asked, the partic- 
ipants were generally content with the 
flow of the conversation and the se- 
quence of the questions made sense. 
However, as already mentioned, the 
users got frustrated when the chat- 
bot forgot the context and asked 
them to start again, and going even 
more in detail, various other prob- 
lems occurred. First, P4 and P5 both 
encountered ignorance, when the 
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chatbot simply did not answer to one 
part of a question or to the question 
as a whole. Secondly, majority of the 
participants thought that the chatbot 
unexpectedly jumped to a new top- 
ic. P8 told that he lost the additional 
features, such as searching for a hotel 
or insurance, since the chatbot gave a 
lot of information at once and he was 
focused on the things that were more 
important at that point. P2 claimed 
that she was still looking for the tick- 
ets if the chatbot already suggested 
the travel insurance and similarly, 
P7, P8 and P15 stated that they would 
like to finish with the flights and then 
continue with hotel or insurance. 
P10 was likewise frustrated about the 
travel insurance, saying that it would 
be the last thing to think of. P12 adds 
that he did not expect to get the home 
suggestion 

when he asked for 

the flights, he would 

be more 


airport 


content 

to answer these questions when fin- 
ished with the flight and concluded 
stating that the chatbot simply start- 
ed spitting answers without much 
logic and. Likewise, P11, P12, P13 and 
P15 all mentioned the understanding 
of voice messages and how it was a 
wrong moment in the flow to jump 
back to the beginning after getting the 
flights. Thus, some of their comments 


go as follows: 

e “Once it showed me the flight, 
the only thing it started to say 
is, OK tell me another flight. I 
mean, why would I look for an- 
other flight? [...| I didn’t real- 
ly need him to actually tell me 
again that [...] I can speak.” (P12) 

e “I already said where I want to 
go and the dates and then it 
goes back to “I can understand 
voice message” and tell me, you 
know, it’s the same thing again. 
So I’m thinking I’m not getting 
anywhere.” (P15) 


Since the users encountered misun- 
derstandings, they were asked how 
the chatbot dealt with these obstacles 
and how they got back on track. The 
process was not rated as a good one 
and P1 said she tried 
to push the conver- 
sation in the right 
direction herself. 
Whereas P4 claimed that the chatbot 
got too confused and referred her to a 
human agent, thus did not resolve the 
situation itself. P12 stated that in the 
worst case the chatbot’s solution was 
okay to ask the user to try to rephrase 
to get back on track. Other comments 
from the participants include: 
e “So if you are forcing me like to 
say again and again Milano, Mi- 


lano... Like this or forcing me to 
think about it like there is noth- 
ing in Milano ...where is? Ah, OK 
Bergamo. It’s not so... it’s not so 
engageable.” (P3) 

e “He doesn’t know how to an- 
swer me to this, [...], it says, 
okay, let's clear it all and start 
all over again..What do you 
need? I mean, it’s clear, it’s not 
making me... I appreciate that 
it's not making me insist on the 
error. But as I told you before, 
probably rd rather want to... 
to reprompt some part of the 
previous conversation, because 
I probably want information 
about the same travel.” (P6) 


QUANTITY - BEING INFORMATIVE YET 
CONCISE 

The sub-topic addresses the issues 
about quantity of information (Figure 
5.7) - if it was sufficient, too much or 
too little. 


OPTIONS 
PROVIDED 


LENGTH 


SKIM THE 
TEXT 4 
QUANTITY 


Most of the users appreciated the fact 
that the statements were not too long, 
yet neither too short and abrupt, rath- 
er fairly sufficient, easy to read and 
concrete. Also, they stated the infor- 
mation being enough and the things 
that they would look for while search- 
ing for plane tickets. However, some 
of the participants still perceived the 
utterances as too long, too many in a 
row or simply repetitive, stating: 

e “At some point I felt that there’s 
too much text. So I had to 
scroll back. And then because 
it popped me like four different 
things in a row. So I had to go 
back and then see like what was 
there. [...] It could be that, you 
know, that the screen is small, 
but at the same time, you know, 
the phone screen isn’t much 
bigger either. So if you’re us- 
ing the phone, then probably, 
you know, it would in anyways 
be better if you have like less 
text. |...] I think it was a bit too 
much for me. Let me see. Yeah. 
Like some kind of picture (looks 
at the GIF)... Why? Why is this? 
You know, either the picture 
“checking prices on skyscan- 
ner” or, you know, “I’m look- 
ing for the best prices for now”. 
Yeah, I wouldn’t need both of 
those.” (P1) 
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e “Literally sent me like 10 mes- 
sages in a row.” (P5) 

e “I find like the first two messag- 
es. The one “I’m searching...” 
So like a loading bar. And the 
following one. Are a bit redun- 
dant? Probably one is enough.” 
(Pu) 


Even though many participants 
missed some of the utterances that 
the chatbot sent, since there were 
many in a row as stated previously, 
they mostly did not comment on it. 
However, some of the participants 
gave hints for the reason: 

e “[...] and it’s just a chatbot, so 
you don’t really read everything 
they say anyways. Like, for ex- 
ample, in the last message, I just 
read maybe the firsttwo words... 
Where it was like “I can under- 
stand voice messages” and then 
I stopped reading...” (P5) 

“I just thought maybe it’s giving 


extra information, something 
like return results or some- 
thing, just that I was drawn to 
the results 
itself. And 
so I didn’t 
read it. [| 
Thinking, 
okay, it’s a chatbot... It gives you 
auto messages. Maybe you don’t 


read them all.” (P7) 


As the interfaces between various 
platforms differed, Pu, using Tele- 
gram, mentioned that the amount 
of how many flights were compared, 
should have been stated. However, 
various other users, P5, P6 and Po, us- 
ing Facebook Messenger or WhatsApp 
platforms, expressed their surprise. 
Others added: 

e “[...| there are not eight hundred 
and forty flights going to Esto- 
nia. It’s not possible. OK. I fly all 
the time and there are not that 
many flights to Tallinn. I can 
promise that!” (P4) 

e ““I found 694 flights”. I mean, 
I don’t want you to list me 694 
flights. I mean, I am expecting 
you to ask me, or at least... to 
have some kind of, you know, 
filtering. I’m not interested in 
694 flights.” (P12) 

Having claimed analysing large 
amount of flights, the users encoun- 
tered problems addressing the simi- 
larity as well as the 
displayed amount 
of the results. P12 
and P13 were not 
content that they 
could only see two options. P4 com- 
plained that all of the flights were the 


same airline’s ones. Likewise, others 
commented: 

e “[...] it sent me only the Ry- 
anair link. So which means that 
it's for me the best option and 
it sent me. But maybe I would 
like to see also other opportu- 
nities or maybe I don’t want to 
travel only with Ryanair. Maybe 
it could send me like one, two, 
three options, at least to see dif- 
ferent companies.” (P3) 

e “Like it’s a very poor list of re- 
sults. [...] I would say it’s it’s in- 
teresting the fact that it showed 
me only one and only one air- 
line also because it is saying 
the cheapest one is this one, 
but then it is showing the other 
two options. Why not showing 
another airline at least? |...] the 
fact that he’s always replying 
with the best three. So I would 
say, why the best three and not 
like the best five or why not an- 
other way of me seeing the re- 
sults?” (P11) 

e “They’re all about the same... 
Sixty. Its the range of ten... 
Around ten dollar difference. 
[...| I mean, it just gives me for 
some reason only between 6th 
and 13th. If Pm not mistaken 
now... December. I’m like won- 
dering, is it only during that 


week, you know, it’s about seven 
days, right? Between 6th of De- 
cember and 13th of December, 
I can see here... Like is it like... 
what about the other days, is it 
only flying during one week? 
[...| ’'m thinking that I if I put a 
whole month. It only gives me 
looks like, it seems like a week. 
Information about one week 
only. I would like to have like an 
overview more.” (P15) 


QUALITY - BEING ACCURATE AND 
HONEST 


The sub-topic addresses the accura- 
cy of the messages - if users encoun- 
tered something that was not true or 
what they believed to be wrong. 


Some users encountered distrust in 
terms of prices. Since P2 entered the 
chatbot through the feed of Facebook, 
clicking on the link where the price 
was already given, she mentioned that 
the first price must have been wrong. 
Similarly, being a frequent flyer of a 
requested route, P4 commented: 

e “[...| I would never buy 300 dol- 
lar tickets to Estonia. |...] I know 
that the prices at the moment 
are a lot higher. That's why I ha- 
ven’t bought the tickets yet. But 
at the moment |...] I think on the 
4th of January is like 120 or 125 
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euros. I think it was.” (P4) 


P10, on the other hand, used the quick 
replies of the chatbot and requested 
a flight from “Milan” to “Everywhere”, 
whereas the chatbot told that there 
are no flights for that route and sug- 
gested to try again. The participant 
was frustrated by that and said thathe 
never specified any specific route. P3 
encountered disappointment when 
she chose “Places” from the quick 
replies and the chatbot had changed 
the context without her understand- 
ing, asking for the location, she un- 
derstood that the chatbot was asking 
for an area inside the city, not the city 
itself. Therefore she got a reply: “I 
didn’t find anything” and commented: 
e “[...| how you didn’t find any- 

thing? Like this is 

the wrong infor- 

mation, you could 

tell me like.. “You 


should also tell me the city 
(P3) 


In terms of supposing the correct 
variable and not specifying, the chat- 
bot failed to deliver expected results. 
When P12 asked for a good weekend 
instead of a specific date, the chat- 
bot automatically took the following 
weekend. Already being wrong by ig- 
noring the good variable or assuming 


that it was the next weekend, it also 
failed by stating the weekend as Sat- 
urday and Sunday, although, for P12 
weekend is Friday and Saturday as 
he lived in the United Arab Emirates. 
Other assumptions include: 

e “[...| it sent me only the Ryanair 
link. [...] maybe I don’t want to 
travel only with Ryanair.” (P3) 

e “It took Christmas as a specif- 
ic date... That's not really what 
I was thinking about. [...] I was 
expecting something more in 
the way of “OK, I will show you 
more or less the flights to go 
and come back across Christ- 
mas”” (P12) 


Finally, when the chatbot gave the us- 
ers the links to proceed to the book- 
ing, it did not choose 
the flight that the 
user already selected. 
Therefore, the chatbot 
did not provide correct information 
and misunderstandings occured: 

e “But since I knew already I was 
okay with that timetable and 
prices, I would rather jump to 
a further part of the flow if it’s 
possible.” (P6) 

e “Iasked for the flight details and 
it’s taking me to another page, 
which again is giving me a list 
of the flights. And by the way, 


there is no sign of the flight that 
I looked for [...] Okay, it’s sold 
out. It’s something that maybe 
we missed. So if it’s sold out why 
are you showing me this?” (P12) 


RELEVANCE - BEING CONSISTENT AND 
RELATED TO THE TOPIC 


The sub-topic addresses if all the ut- 
terances were relevant to the chatbot 
or if users perceived chatbot talking 
about things that were not important 
in this case. 


The users perceived everything as 
relevant, and the ones who got asked 
about setting the home airport or if 
the users were provided the addition- 
al services, they were mostly content 
with it. To illustrate: 

e “[...] like is Tallinn my home 
city? So for the future search- 
es and so on. Like something 
that it might... Shouldn’t... Like 
it wasn’t like necessary to ask. 
But yeah, maybe for the future 
so that it would be faster and 
easier.” (P1) 

e “Maybe the ending is a bit like 
“hey, we want to sell you more 
services”, but I would expect 
that anyways because it’s like 
free app. Like I wouldn’t need 
them. And then the last post, 
this is more like information. 


But again, like I don’treally mind 
that, because I understand why 
there’s sending it. And I can just 
ignore it if it’s not relevant.” (P5) 


ENDS - HAVING A PURPOSE 
AND STRIVING TOWARDS THE 
GOAL 


The second most frequent theme de- 
tected addresses different purposes, 
goals and outcomes. Codes like prior 
use, website alternative and final out- 
come were discussed under the theme 
of ends, as seen on Figure 5.8, and are 
followingly described in detail. 


PRIOR USE - ADDRESSING PAIN POINTS 


The sub-topic (Figure 5.9) addresses 
the experiences users had before with 
conversational interfaces and chat- 
bots in specific. Also it takes into con- 
sideration the usual booking process 
and pain points they go through. 


When talking about chatbots, users 
were first asked about the usage of 
conversational interfaces in general, 
these days the most popular are the 
ones found in smartphones and at 
homes - suchas Siri, Google Assistant, 
Google Home etc. Only one of the par- 
ticipants of the current study, P8, said 
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that he uses these in- 
terfaces alot, but main- 
ly at home, to listen to 
podcasts and music, 
track his daily appoint- 
ments and productivity 


SPEECH-BASED 
VIRTUAL ASSISTANTS 


EXISTING PRODUCTS / 


ALTERNATIVE EXITING BOOKING 
THE FLOW TRAVELS 
BOOKING 
PAINPOINTS 
SELF CONFIDENCE | 
PRIOR USE 
REASONS > a CHATBOTS 


FOR USE 


in general. Most of the 
participants, however, 
claimed to not use any 
of them regularly, just 
sometimes when they 
are on the go to ask it 
to call someone, for 
the meaning of a word, the name of 
a song or simply to goof around and 
try it out. P1 and Pio never saw the 
real good benefits that could help to 
facilitate everyday life, and latter even 
added that he deactivates Siri from 
his smartphone. Two of the partic- 
ipants claimed that their kids use it 
more and P15 even said that she talks 
to Siri to apologize to it since her kids 
were teasing it. Asking more in detail 
why they do not use it, the partici- 
pants commented: 

e “It’s not engaging, because it’s 
not understanding what I’m 
saying and... What is my expec- 
tation from a personal assis- 
tant is like... you’re always with 
me, you're always in my pocket. 
Please know me and don’t force 
me to say every time the same 
stuff. If I’m asking you every 


CONCLUSION 


IMPORTANT 
ASPECTS 


FINAL OUTCOME 


NO ADDED 


VALUE E N DS 


day some specific questions, 
you can be ready for this kind 
of question. So because it’s not 
convincing me and I’m not us- 
ing them.” (P2) 

“I find that when Siri first came 
out, it was a bit useless. And I 
don’t really need it... Like I’m 
happy to just type in the ques- 
tion myself. Alexa... I don’t real- 
ly feel comfortable with some- 
thing recording passively in my 
home the whole time. So I don’t 
really want to get one home.” 
(P5) 

“If I have to look for something, 
I don’t ask it because I can do it 
on the phone. And I don’thave to 
wait, you know, for the answer. 
The answer maybe is wrong. I 
don’t know. It's just quicker to 


just look at it on the phone” (P12) 


One participant, P5, saw it as useful 
for less tech savvy people and recalled 
a dinner where a 70-year-old French 
man took out his phone to ask Siri for 
information, it answered quickly and 
correctly. However, she claimed feel- 
ing much more comfortable Googling 
and being able to see the results and 
ones relevant to her. Other similar 
aspects stood out from the current 
study - P6 and P8 simply did not want 
to speak with it in public, and Pu stat- 
ed: 
e “On my phone directly... I tend... 
I use [conversational agent] very 
rarely because I use my smart- 
phone very often in public. So I 
tend to be kinda embarrassed in 
using itin front of other people.. 
[...| I don’t want people to know 
what I’m asking to my voice as- 
sistant.” (P11) 


While using the chatbot during the 
study, a couple of them commented 


SPEECH-BASED 
VIRTUAL ASSISTANTS 


BOOKING 
TRAVELS 
BOOKING 
PAINPOINTS 


PRIOR USE 


CHATBOTS 


in favor of the speech-based interac- 
tion, that the chatbot supported. P3 
said it is simply more natural and hu- 
manized for her, P15 saw its time-sav- 
ing benefits in comparison to typing. 
Some other thoughts go as follows: 

e “And the voice messaging thing 
seems like cool as well. Be- 
cause I know a lot of people use 
WhatsApp under voice.” (P5) 

e “I don’t have time to go to an- 
other application right now, be- 
cause I’m in Google and maybe 
I’m walking or I’m driving, so 
it’s nice that I can talk to it with 
the microphone... |...] no need to 
type, no need to select filters, no 
need to do anything [...]” (P12) 


Since it could help understand the use 
and shortcomings of the chatbot, the 
facilitator asked about the usual plan- 
ning of travels, as well as drawbacks of 
the flow. In general, all of the partici- 
pants could relate to the field of trav- 
elling and are more or less regularly 
searching for flights themselves. Most 
of the participants frequently made 
use of Skyscanner, and they men- 
tioned also Google Flights, Momondo, 
azair as well as various airlines, such 
as Ryanair, Alitalia, easyJet, Turkish 
Airlines, AirBaltic and Norwegian. 
Overall they asserted the existing 
flows being easy to use and the ex- 
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perience as rather good. Participants 
found it convenientto use the filters to 
find the most suitable flight for them 
and P3 asserted checking also the 
suggestions about what to do in the 
travel location, directly from booking 
websites. P1 claimed that since she is 
a great travel planner and thus, usu- 
ally puts a lot of time into finding the 
best options. Also, others added that 
they usually check Skyscanner, but 
often cross-check with the official 
websites to make sure they get the 
best offer. The participants presented 
various diverse pain points, for one 
it was a trouble finding mutual times 
with friends or for the other it was 
rather the budget sharing while al- 
ready travelling. Some had problems 
with the usability - even logging into 
the application or typing in the same 
information many times. Also, when 
purchasing tickets through metase- 
arch engines, such as Skyscanner, it 
is difficult to contact someone when 
encountering problems with flights 
or even simply to trust it. It is evident, 
travelling is expensive and that makes 
users sensitive. Some pain points that 
came out from the study and can be 
useful to advance the chatbots: 

e “[...|] when you visit the Web 
site... Like after a couple of 
times, they’re starting to in- 
crease the price. |...| Or like 


maybe you want to book two 
people... When you update the 
number of people, the website 
is showing you something dif- 
ferent, some different offers. 
So in that point sometimes like, 
I want to ask to someone like, 
what is the problem?” (P3) 

“[...] I know what that Mondays 
and Friday and Saturday morn- 
ings are the high prices. So, you 
know, I°d still check, but I al- 
ready know... I always end up 
flying on another day. But the 
idea something that you kind 
of have to click back and forth 
on the date bar there, instead of 
like having them side by side.” 
(P4) 

“Well, I guess the travel search 
engines, they optimize either 
for how much time you want 
to spend traveling versus how 
pricey it is. So sometimes the 
cheapest option might not be 
the option I’m looking for be- 
cause it has like a seven hour 
layover somewhere. So even if 
the algorithm pops up with re- 
sults, then you might want to 
dig deeper and like actually look 
at what the result means. [...] 
Sometimes I want go to England 
first, then travel home, because 
it's cheaper than flying straight 


from Paris to Estonia. But that’s 
something that the skyscanner 
would never suggest me to do 
because it doesn’t have friends 
in London that I’m happy to visit 
anyways.” (P5) 

“But the first thing that I check 
always are like the dates, what is 
the cheapest price? And if there 
are like connecting flights, that 
the time between the flights 
would not be too long. That’s 
like the most important thing 
that I check. That this is the 
most important thing that I 
want from the Web site. It would 
be easy to get that information 
on the site.” (Po) 

“It happens so often that you 
find a good place, good price, 
but then you’re going to make 
the check out of the payment 
and it starts to increase.” (P10) 
“I tend to take a look at the 
flights many times in a month 
prior to the departure. So ev- 
ery time I’m kind of worried 
that the algorithm of the air- 
line is kinda showing me, let’s 
say like... defected prices. So I 
tend to navigate in incognito or 
from another computer. This is 
something that I tend to be kin- 
da annoyed about.” (P11) 

“Like maybe there is a pricing to 


250 and then you go to the web- 
site and it’s actually 400. But I 
don’t know whose fault is that.” 
(P12) 


Another thing that disturbed some of 
the participants was the offering of 
additional services: 

e “There are so, so many steps 
and with so many extra services 
offers to make up-selling and 
even if you know what, it’s actu- 
ally a lot of chaos and unneeded 
chaos” (P6) 

e “[...] confused because there 
were so many offers that they 
offer like. So I got confused if I 
need to add all the bags there or 
should I not? It was too much 
and too complicated.” (P13) 

e “I can’t really find useful infor- 
mation, |...] And then I couldn’t 
find any information regard- 
ing the luggage. If the luggage I 
have.. Is it included or not? And 
then I tried to find the informa- 
tion.” (P14) 


To go to the core topic and talk about 
chatbots in detail, it is first worth 
mentioning that none of the partici- 
pants had ever heard of that specific 
chatbot before. To go deeper, par- 
ticipants were first asked if they had 
noticed these bots somewhere and 
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if they had used them before. Most 
of them had had a brief contact with 
chatbots before and had noticed them 
popping up on various websites and 
applications. P1 claimed rarely using 
and even avoiding these. Similarly, P2 
and P3 stated not using chatbots often 
and only if they had to, if there was no 
other option. P5, however, stated that 
she never bothered to use chatbots, 
she simply does not see any addition- 
al value. 

According to the pessimistic opinions 
and even avoidance, the users were 
asked about the reasons why they did 
not want to talk with the chatbots. P2, 
P8, P11 and P13 jointly stated that they 
prefer to talk to real people, not com- 
puters. P8 added that it might come 
in handy with basic problems, but 
often the problem is too specific or 
sensitive. And P11 asserted, if it is not 
possible to talk to people, she relies 
on her own skills. Similarly, P1 and P5 
agreed and added: 

e “[...| because I know the log- 
ic behind it that they are they 
are programed to sort of an- 
swer some certain questions 
and then it seems to me that 
Pll probably get the answer 
anyways somehow. Like rather 
than putting my time into it and 
trying to explain them what do I 
need to know.. For me it seems 


that if the answer is somewhere 
in web, then PI get it faster than 
trying to get the answer from 
the chatbot. (P1) 

e “I don’t know.. to me, this just 
seem like they’re not really add- 
ing much value because. I have 
never used them myself, so I 
don’t really know if they work 
well, but it feels like why do 
you even have one, shouldn’t 
your website be self-explanato- 
ry enough? And then you nev- 
er know if it’s like robot you’re 
talking to or if it’s a real person. 
|...] If it’s usually in the website 
you can find the information 
you need on average anyways. 
And if I can’t find it, then I 
would never use to chatbots to 
ask. |...| I feel like if the website 
isn’t good enough to explain it 
to me, why would a chatbot be? 
And then if the chatbot does 
do a better job, then I feel like 
there’s something else wrong... 
Like if you need a chatbot to ex- 
plain to people how to use your 
website, then you’re not a very 
good product in the first place.” 
(P5) 


To take one step forward, users were 
asked about concrete examples and 
how had the experience been thus 


far. There were both good and bad 
instances. Po and Pio were mutual- 
ly disappointed as the chatbot sim- 
ply did not solve 

their 
P4 mentioned an 


problems. 


incident when 

the chatbot went 

crazy and always answered the same 
thing, similarly to P3 who added that 
in her case the repetitive answer was 
very long and general. P7 and P14 both 
recalled a likewise situation when 
the chatbot copied a long Frequently 
Asked Questions page. P11, however, 
claimed the experiences had been 
very poor in general, thus she had 
learned a trick to trigger the chat such 
that she was directed straight to a real 
assistant. 


However, as mentioned, the partici- 
pants had had also good experiences. 
P2 and P7 both recall positive con- 
versations when their specific prob- 
lems actually got solved, although, as 
it turned out, in both cases with the 
help of a human agent. Despite the 
interruption of a person, P2 felt that 
the chatbot was thinking along. Simi- 
larly, P4 recalls that if the chatbots are 
not able to solve the problem, she has 
been directed to a person. However, 
she has also had issues fixed directly 
by chatbots, but saw these problems 


rather easy. Pio also remembered a 
chatbot that has solved many of his 
problems. It is clear from the results, 

that the expe- 

rience is good, 
when the user’s 
problem gets 

solved and it does 
not matter if with the help of the chat- 
bot or a human being, as stated by P7 
and Pio. Some additional thoughts 
about the topic go as follows: 

e “[...] there is one which is like 
really specific.. Like which has 
basically all the chatting pro- 
grammed in. So this is some- 
thing that sort of fulfills my 
needs or this is easy. And it 
seems that itis good to commu- 
nicate with it, because it sort of 
knows what will you say or how 
to act on each answer.” (P1) 

e “In the end I gave up, but it send 
me a notification like “Hi, still 
I’m here to help you”. And in that 
sense, I felt a bit like.. Kind of a 
person is waiting for me there. 
And I didn’t end it up, I didn’t 
see I mean the point, like a cross 
or something, to leave the con- 
versation. And I went back and 
I said like, “OK, but you’re not 
solving my problem. So thank 
you so much, but you can end it 
up”. And then it connected me 
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with the true people, let’s say.” 
(P3) 


Despite protesting opinions, the par- 
ticipants claimed that if the chatbots 
will work better in the future, they can 
see the benefits. P3 stated that they 
will be useful for planning everyday 
things, such as trips. P2, P7 and P13 all 
assured that it would be a quick and 
convenient way to contact the ser- 
vices, without the need to email or 
call to a stranger. 


EXISTING PRODUCTS - 
ACKNOWLEDGING FAVORED 
ALTERNATIVES 

The sub-topic (Figure 5.10) mentions 
the reasons why the participants per- 
ceive the website alternative better 
and more useful. 


Throughout the interview, mostly all 
of the participants mentioned that 
they do not see any reason why they 
would use the chatbot as it was not re- 
ally helping them and they were able 
to do the same thing by themselves - 
they were self confident and trusted 
oneself more. P4 simply preferred the 
usual approach, as did P2 who felt that 
going to Skyscanner was not burden- 
ing her. P1 stated that she would find 
similar things herself and P13 claimed 
to find even more information. Being 


content at first, but after encounter- 
ing an error, Pio said he would have 
left straight away to do it again on 
Skyscanner. Some other opinions go 
as follows: 

e “Maybe I trust myself more 
so Id go with this Skyscanner 
rather than doing this.” (P2) 

e “Quickly put in, which literally 
takes me 10 seconds, you know 
- London any, to Tallinn or 
whatever it is and put the date 
in and that’s it. Like it takes you 
the same amount of time. I don’t 
need someone else to process 
that for me. |...], I don’t need to 
talk to someone in Facebook 
Messenger conversation to an- 
other human to book my plane 
tickets. Its like it feels a bit 
dumb... I can go on a website 
and I could buy those tickets 
myself. I don’t need someone 
else’s help to book my tickets.” 
(P4) 

e “So far right now I would still 
say that I prefer the traditional 
way of searching just because 
rm feeling like I’m faster than 


EXISTING PRODUCTS 


ALTERNATIVE EXITING 


THE FLOW 


SELF CONFIDENCE 


this. Probably just because I’m 
overconfident...” (P11) 


Even if they would use, the partici- 
pants mentioned that they would do 
a double-check anyway. P2 and P4 
preferred to search again themselves 
to see if she could find a better solu- 
tion. Pu and P13 simply stated that 
they would search for more results. P5 
showed total distrust, stating: 
e “Well, for me, even if it comes 
up with something and says the 
best price available, ’'m sure I’m 
going to go and look myself any- 
ways.” (P5) 


As mentioned, they prefered to use 
already well-known alternatives. To 
P2 and P5 it simply did not make sense 
to use a chatbot that was using Sky- 
scanner, the platform that they would 
use themselves. Po took the chatbot 
as an extra step to using the website. 
Other reasons they gave in the benefit 
of the websites: 

e “Whereas if I’m on Skyscanner, 
I just put that in... it’s one search 
and it’s done. I don’t have to 
keep going back to tell things to 
it.” (P4) 

e “I would never fly around this 
range and I would probably play 
around with the dates and see 
which dates are the cheapest.” 
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(P5) 

“I already know what I need to 
do and where to find it. And [the 
website it’s not telling me oth- 
er things... It's easier to roam. I 
don’t know, it’s faster to... Not 
easier! Not always easier, but 
faster to roam informations in 
the in full, for me... In the way 
I’m used to.” (P6) 

“I would like prefer to go to Mo- 
mondo and check it out myself, 
to see it like all the graphics, all 
the prices compared to each 
other.” (P9) 

“[...] until now, there is no way 
why I shouldn’t have gone to 
Google flight and did the same 
thing. And gotten the flights 
in a much nicer list and much 
easier to actually then go to the 
website of the company. |...| It 
didn’t bring me anything else 
that I didn’t have if I went to 
the Google Flights. And actually 
it’s slower so far, because... OK, 
I put the dates... Let’s assume 
that the dates are exactly 25 and 
4th. But then, you know, I’m not 
really seeing all the flights. I’m 
seeing like two of them at the 
time and if I click, then I have to 
look for them again in this oth- 
er website. And then maybe I 
will eventually get to the Etihad 
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page. And that’s not what I re- 


Finally, the participants were pleased 


ally wanted to do. I want to just to exit the chatbot and find something 


click here 

and get to 

the Etihad 

page, in 

which the 

flight was 

already se- 

lected, which is what Google 
Flights actually does.” (P12) 

e “I would already like go back 
to Skyscanner directly. I would 
prefer like Norwegian has, you 
have like a whole calendar and 
you can see the prices right 
away per day.” (P15) 


Some of them noticed the fact of us- 
ing the chatbot only for a limited time. 
P11 saw the chatbot as an entry point 
to already familiar websites. Partici- 
pants commented: 

e “They expect you to click on it 
and like automatically sends 
you away from the chat app. So 
you only use the chat for like a 
few seconds in order to arrive to 
what are you looking for.” (P5) 

e “So the fact of having and keep 
going with the conversation is 
very weird because immediately 
Ihave something that is pushing 
me outside.” (P11) 


more familiar, 
as stated by P14 
and P15. P5 and 
Po were content 
with the overview 
of the dates and 
latter added that 


that was the place she could actual- 
ly buy the tickets from. Others com- 
mented commented: 

e “Even if I was using this in the 


real life scenario, then I prob- 
ably wouldn't keep asking it to 
change things. I think the point 
where they sent this link, Td 
probably click on it and then 
do my changes in the filter, be- 
cause it was clear that it couldn’t 
deal with something. So it’s just 
quicker for me to go in and 
make those filter changes.” (P4) 
“It’s good, I think... It goes out 
from the chat, [...] Now I under- 
stand if I’m going to this site, 
then it’s something like... I un- 
derstand it’s some site that of- 
fers different tickets and this is 
like more understandable for 
me. It’s like real offers.” (P13) 


FINAL OUTCOME - ADDING VALUE 

The current sub-topic (Figure 5.11) 
addresses the final thoughts of the 
users, what did they think was the 
most important while chatting with 
the chatbot, what were the benefits or 
what was missing - the final thoughts 
of the experience. 


Some participants, such as P1 and P14, 
were positively surprised, since they 
received the results that they were ex- 
pecting and they were content with. P1 
would use it in the future to compare 
with one’s own results, although, she 
mentioned the chatbot lacking of pro- 
activity. P7 also mentioned that there 
was nothing missing, and praised the 
chatbot for asking additional infor- 
mation to make the experience bet- 
ter in the future. He appreciated the 
language the chatbot used and the 
way the results were visually simpli- 
fied. Also P8 noticed the conversation 
being understandable for him, as well 
as less tech-savvy users, such as his 
mother. Similarly, he predicted us- 
ing it more in the future since it was 

easy to han- 

dle and did 

not require 


REASONS too much 


FOR USE 
engage- 


ment. What 


IMPORTANT 2 
is more, he 


ASPECTS 


CONCLUSION 


FINAL OUTCOME 


NO ADDED 
VALUE 


appreciated being able to use it from 
different platforms and devices. Like- 
wise to others, Po liked the use of 
language and felt that it was easy to 
talk with, she would return to use it 
if she would have questions about the 
flights while booking tickets. How- 
ever, not all the participants were 
content with the outcome and most 
of them would not use it again. P11 
simply thought that chatbots are not 
good enough compared to other solu- 
tions. P12 stated that the chatbot did 
not do what he expected and he could 
easily just close it without caring. P2 
saw it as a fast way of throwing the 
options, yet would choose to do it by 
herself. Pio claimed being frustrat- 
ed after encountering an error and 
would not use it ever again, he stated 
that he would even tell his friends not 
to use it due to his poor experience. 
Other participants answers after be- 
ing asked if they would come back to 
use it: 

e “I don’t know, I don’t really find 
like booking plane tickets...I 
don’t need to have a conver- 
sation with someone, whether 
that’s a bot or it’s my sister, you 
know, like I don’t need to have a 
talk about buying tickets. I just 
go to the website and put in my 
filters and... Which like takes 
me super short time. And I just 
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look there. I don’t need to go to 
the website, then go back to the 
bot to ask for changes, then go 
to the website after they give me 
the link again... like it's seems a 
lot more steps than necessary. 
|...| so I don’t really see how it 
gives me a better ticket... buying 
ticket experience or whatever.” 
(P4) 

“No. [|...] I don’t need it. It’s not 
doing anything that I can’t do. 
It is not really better than the 
stuff I’m doing at the moment. 
[...| I feel like it might be quick- 
er when I’ve been there on an 
actual website rather than just 
like asking a chatbot every sin- 
gle question. [...| For me, it still 
feels like I’m talking to an online 
search engine. It doesn’t feel any 
more intimate, than Googling 
or... [...] but it doesn’t feel more 
like... More than just an internet 
search at the moment for me at 
least.” (P5) 

“I don’t know. I’m not used... I 
mean. I didn’t feel to have some- 
thing more than the way I usu- 
ally search for these informa- 
tions [...] And I don’t really need 
to talk, to have a conversation 
to find this kind of information. 
|...) it is a form. [...] It’s even in 
the same kind of experience of 


the search bars on the websites. 
[...| I think that the... That the 
feeling to talk with a machine is 
the thing that. It's the worst part 
for me,” (P6) 

e “No. |...] I would say that mis- 
sion notaccomplished. It's not... 
Yeah. I didn’t get... I didn’t get 
the information I was hoping 
for. |...] how the chat is up. This 
is like... it's not ready, I’m think- 
ing. Like something is missing 
there” (P15) 


The participants named several as- 
pects what they sensed missing in the 
chatbot. P12 wanted to see some alter- 
natives and to have a sort of negotia- 
tion. Likewise, P1 lacked of proactivity 
and added that the most important 
was to get an accurate answer, that 
also P12 mentioned. Pio agreed and 
stated that it was very frustrating to 
feel like the chatbot was not paying 
attention to what he was saying. Oth- 
ers commented on the conversational 
manner: 

e “What is needed is the ability to 
elaborate more complex con- 
versations where I can, where 
I don’t find like copy and paste 
messages where I can, maybe 
I... I receive the same exact in- 
formation, but I feel that he is 
giving this information to me 


in a slightly different way based 
on how I am talking to it. This 
is the worst part for me to feel, 
to really feel the conversation 
to be artificial, since it’s repet- 
itive... since it’s not, I mean, it’s 
giving me relevant information, 
but it’s not really answering to 
my way.” (P6) 

“I think that the conversation- 


al manner of it, because he was 
pretty flat.” (P8) 


Another aspect that the participants 
brought out was the fact that the 
chatbot did not give any addition- 
al value to them, as clearly stated by 
P5, P6 and Pui. P2, P4 stated that she 
could get the exact same information 
herself with the same amount of time. 
Others added: 

e “[...]) maybe my expectation was 
higher. Since they designed this 
system, I was expecting like 
it’s gonna do more than me. So 
that’s because he’s there and 
I can ask... But actually... And 
then I saw that, no, if I’m going 
through the website, I’m going 
to do the same,” (P3) 

e “Like the one part where it does 
like do something different is 
that at the end wards it is like 
suggesting that like... extra ser- 
vices, but I feel like at normal 


agencies online would do the 
same.” (P5) 

e “It’s just a website that it’s us- 
ing words instead of of textbox 
for me to filter. And I don’t feel 
like it's more than this. [...] More 
than humanizing all this filter- 
ing, it is not really doing much 
more.” (P12) 


However, in addition to being more 
collaborative and asking follow-up 
questions, as mentioned before, some 
participants suggested a few aspects 
that could give the expected extra val- 
ue: 

e “Maybe if we can do like collec- 
tively, like, how can I say like... 
with 3 people, with this chatbot. 
Maybe it can be really useful. [...] 
Maybe it would be really, really 
useful for me while I was looking 
for an apartment around some- 
where. Not only for traveling. I 
would like to use it, because like 
you don’t know the language 
where you are living.” (P3) 

e “Might be even that you can in- 
clude a fast track or something 
like that, like for instance if 
there is... I don’t know, a longer 
layover, what could work for me, 
is like, you often think that the 
business lounge is gonna be so 
expensive, but actually some- 
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times in some airports it would 
be 30 euros or something, but 
it pops out: “But would you be 
interested to book, you will be 
staying in, for instance, Frank- 
furt for eight hours, the lounge 
is only 30 euros” or something. 
“Would you like the book that” 
or something like that? That 
would be cool like that... at least 
for me, that extra value that an- 
alyzes the travel specific case 
and offers me something extra 
that I might not have thought of 
myself.” (P7) 

e “Yes, maybe some sales or...” 
(Po) 


On the other hand, P1, P5, P13 and P14 
mutually saw convenience as an ad- 
vantage. Similarly to P5, P7 and P12, 
who found the chatbot being quick. 
P5 added that one can simply open 
WhatsApp and get a first rough over- 
view of the costs and options. She 
also mentioned the ease of use and 
saw the chatbot fitting for people who 
did not have much time and preferred 
to use an assistant when booking a 
travel. Although, she believed them 
being less price sensitive. P4, how- 
ever, mentioned the chatbot useful 
for older people, who were not that 
tech-savvy. Additionally, P7 appreci- 
ated the fact that the chatbot pulls the 


information from various places, such 
that one does not need to go look on 
different platforms himself. 


BEHAVIOR - BEING POLITE 
AND BUILDING CONNECTION 


All behavior is communication, as stat- 
ed in the literature review. Thus, dif- 
ferent aspects of chatbot’s behavior 
were investigated and are followingly 
given a detailed overview. Since be- 
havioral codes were less frequent, 
the current sub-topic does not divide 
them into smaller parts and describes 
the various topics seen on Figure 5.12 
under a common label of “Behavior”. 


To start with, many of the participants 
mentioned the chatbot as “human- 
ized” and “human-like”. P4 and Pio, 
even mentioned that until one point, 
if they would not have known, they 
would have thought they were talking 
to a human being. Po added that she 
thinks of it as a person, rather than a 
computer. P4 praised the fact that the 
chatbot was not hiding its Al-entity 
and did not pretend to be a human. P1 
and P7 appreciated the smartness of 
the chatbot and P7 added that it felt 
like somebody was listening to him 
and correspondingly adapting. Sim- 
ilarly, P8 took it as a very intelligent 


“I would say that mission 
not accomplished ... 
it’s not ready, Im 
thinking. Like 
something is missing 
there” 
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computer, though, not as a person. 
P15, on the other hand, said that the 
chatbot could be more intelligent. 
And P12 claimed that the chatbot was 
not doing much more than simply 
humanizing the filtering. Other users 
were frustrated by the facts that: 

e “Just because of the... Even if I 
say Milano to Los Angeles. Ask- 
ing me again where you're fly- 
ing from. It’s kind of a stupid 
question to me.” (P2) 

e “But after that it gives me the 
options and goes back to the 
same. Okay. “Hi, I’m Eddy.” So 
it’s like, okay do we start all over 
again? So, no, not like a person. 


No.” (P15) 


However, what made many of the us- 
ers perceive it as “humanized”, were 
the use of emojis that also resembled 
non-verbal communication to many 
of the participants. They mentioned 
the emojis adding a fun feeling, such 
as the emoticon with the sunglasses 
that attempted to give a cool impres- 
sion. P1, P6, P8, Pio and P13 did not 
perceive any non-verbal communi- 
cation, but some of them mentioned 
it lacking also in everyday chats with 
humans, so they did not really miss 
it either. P11, on the other hand, per- 
ceived the profile image as non-ver- 
bal information. 

Similarly, P2, for example, men- 
tioned the logo used and the per- 
ception it gave. She saw the attempt 
for a cool attitude and perceived the 
name “Eddy” as an effort to be more 
of a friend. Also P7 draw attention to 
the name and said he liked it. P12, on 
the contrary, saw the effort in using 
the real name, but mentioned that it 
did not take away the perception of a 
chatbot. Similarly to P2, P11 noticed 
the aspect of friendliness and thought 
a step forward, mentioning that prob- 
ably the product is more targeted to 
voung people, and coming from the 
design of the logo, maybe even direct- 
ly to backpackers. She also reflected 


the target from the fact that the chat- 
bot mostly gave low-cost airlines as 
the options. 


As mentioned, friendliness was men- 
tioned by majority of the participants 
and they perceived the attitude nice 
as well as proper. They appreciated 
that the chatbot was not trying to be 
funny and make use of extensive hu- 
mor or small talk. However, P2 and 
P3 would like to see the chatbot being 
even more friendly. Some of the us- 
ers also commented the chatbot as 
respectful, yet straightforward. Latter 
being a quality 

that the partic- 

ipants valued a 

lot, since they 

do not need the 

chatbot to be too colloquial. There- 
fore, they perceived that there was a 
correct balance between formal and 
informal - since looking up a travel 
is a rather formal activity, the users 
want the chatbot to stay profession- 
al. However, P8 added that he would 
not want it to be more formal, since 
there is a lot of data to be handled and 
it would get too serious. P13, on the 
other hand, would like a more profes- 
sional and polite approach. Similarly 
to the prior opinion, also P2 expect- 
ed the chatbot to be more polite and 
P14 would like to have some more 


“please” or “kindly” when the chatbot 
is coming up to her. Other partici- 
pants agreed the chatbot being polite 
enough, yet staying slightly informal 
- like talking to a friend of a friend, 
according to P3. 
Finally, since most of the users per- 
ceived the chatbot being rather 
friendly, they were enquired about 
a connection and relationship they 
were building. P7 was rather positive 
saying that after a brief conversation, 
he could imagine that coming back 
next time the chatbot will remember 
his preferences, thus he started to 
feel sort of a con- 
nection. Whereas 
most of the other 
participants nev- 
er felt any kind of 
connection. P4 added that she would 
not expect it from a tool and some 
others commented that it was just a 
question-answer flow, or as P5 stat- 
ed, it felt like talking to a search en- 
gine. P11 and P12 told that they could 
simply close the chat without feeling 
bad about it. P3, P10, P12 and P15 all 
perceived the connection as growing 
in the beginning, but they mutually 
agreed that after a while it came back 
to the zero point. They commented it 
followingly: 
e “Actually like it could it be... but 
it didn’t.. It gave me the insight. 
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Like, OK, it’s like... Found 44 
flights... Here are the best op- 
tions, but only one option. And 
then it stopped. Like, it just..he 
just said to me, “I can also track 
prices of these flights” and so 
on. But then it’s like stopped.. 
I was expecting more. |...| like 
“do you know what? I shared a 
post on Facebook, I’m going to 
send you. Maybe you can see 
best finding... or like the pic- 
ture, like a best place in Bar- 
celona” or something... I was 
expecting more like, you know, 
like a friend of a friend.. “Yeah, 
I was there! There was nice...or 
like stay around there, because 
it’s like a really nice place or like 
there are many good cafes”” (P3) 

e “[...] at first it was okay. You 
know “I’m Eddy...” a nice icon. 
“Tell me where you want to 
go”... Blah, blah, blah. And then 
I started to see that it’s just spit- 
ting answers without much log- 
ic.” (P12) 


CONVERSATIONAL STYLE - 
INCLUDING EMOTIONS AND 
REDUCING EXERTION 


The theme concerns with Tannen’s 
approach of how things are said. 


Meaning, the use of words, emotions, 
and the speed of conversation are an- 
alysed. Similarly to the previous, the 
topic will be described as one. 


Likewise to the perception of behav- 
ior and supposedly coming from that, 
also the conversational style was seen 
rather friendly and easygoing, casu- 
al everyday talk - however, keeping 
a slightly formal, business-client as- 
pect. P5 labeled the language used as 
a normal Internet language. In gen- 
eral, the sentences were perceived 
as proper, likewise to the vocabulary 
used, as some stated: 

e “I’m reading it and I can al- 
most imagine someone just like 
standing next to me and casual- 
ly telling me this.” (P4) 

e “I don’t need to be a pilot to un- 
derstand what it is telling me.” 
(P6) 


Also, the participants appreciated 
the use of emojis and how it helped 
to keep the text brief, yet more live- 
ly. It gave a feeling of a regular chat 
- simple and short. However, the par- 
ticipants did not distinguish any spe- 
cific emotions or change of reactions. 
P8 even said that it was a rather cold 
conversation, from that perspective. 
Pu noticed the effort of using emo- 
jis, however, she did not perceive it 


as very emotional. She added that the 
emoticons were used in a consistent 
way, thus presumed a use of script, 
such that every time the chatbot was 
mentioning flights, an icon of plane 
was displayed, etc. To make the con- 
versation more affecting, P1 suggest- 
ed: 

e “Maybe some, I don’t know, 
some great jokes or something 
about |...] the destination or 
“Good pick!” or something like 
that, you know. Would have put 
some more emotions into it.” 
(P1) 


Coming from the lack of emotions, 
some of the users did not perceive it 
as a conversation at all, but rather an 
artificial dialogue with a machine. P6 
claimed his own answers to be orders 
and P12 noticed that the chatbot’s 
sentences were more human-like 
than his own. Their thoughts were as 
follows: 

e “I mean it’s not a conversation... 
For example, I just wrote like, 
“hey, bro”. And yeah totally like, 
“I could not find any airports 
around there.”” (P2) 

e “It's not reacting to what I'm 
telling. It’s just prepared to an- 
swer in a...in some way. [...] we 
are just moving on a path that 
is prepared for us and we don’t 
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need to.... Yeah, it’s a lot... Guid- 
ed a lot. How do I say... It’s on 
track, it’s an on-track conver- 
sation.” (P6) 

e “Maybe for my mother it’s a con- 
versation. But here... From my 
user perspective, it’s just... Pm 
making a question, I’m asking 
an answer. And my past is that, 
I know that my question needs 
to be a word or something more 
than a word. And the way I think 
about that is because the chat- 
bot is not saying “Hey-hello P8, 
these are the flights..” It’s just 
like “These are the flights”. It’s 
more like a service.” (P8) 


However, to talk about the pace of the 
conversation, users noticed that the 
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chatbot answered very quickly and 
many appreciated the fact. Howev- 
er, P1 stated that the chatbot sent her 
different 
things in a row, 
thus she had to 
scroll back and 


four 


see what it said. 
Similarly, P14 suggested to give the 
information slightly slower. A partici- 
pant even expressed scepticism: 
e “It answers very, very quickly. I 
mean, I barely hit enter on the 
UK pound please and it already 
answered me. That’s kind of 
crazy, is it reading as I’m typ- 
ing...?” (P4) 


In addition to chatting through free 
phrases, majority of the participants 
made use of quick reply buttons and 
appreciated the fact that they were 
able to use them. However, having 
talked with the chatbot through typ- 
ing the whole time, P12 was frustrat- 
ed when he faced a dead end as the 
chatbot expected him to click a quick 
reply button. 

Other UI elements, that can be seen 
as characters of conversational style, 
were the cards that displayed the re- 
sults of the flights. Mostly, the partic- 
ipants were content with the overview 
and appreciated the information that 
was given. P2 and P7 needed some 


time to understand the information 
about the layovers and similarly, P12 
mentioned that more data, such as 
the location and 
duration, could 
be given about 
that. P2 praised 
the fact that the 
cards can be swiped, however some 
others, such as P12 and P13, had a 
hard time understanding it and thus 
criticised the comparison - itis worth 
noting that they were all on Messen- 
ger desktop views. Similarly, P5 on 
WhatsApp and Pu on Telegram, com- 
plained about the comparison since 
the cards were given one under the 
other and thus, they had to remem- 
ber the details to analyse the results, 
stating: 

e “It’s like it’s kind of hard to com- 
pare two different results. May- 
be if they like formatted in one 
big picture rather than sending 
eight different pictures. I think 
it would have been much easier. 
But like... At the moment, I have 
to putin quite a lot of effort my- 
self to understand what it sent 
me.” (P5) 


What is more, both of them were 
overwhelmed and expressed surprise 
when the chatbot sent the long list of 
options. Also, P11 noticed there were 


always the same number of results 
displayed, making the conversation 
appear as following a pattern. She 
concluded the list of results as poor. 
Likewise, P12 demonstrated annoy- 
ance by the fact that he could only see 
2 out of 694 flights, even after he found 
the possibility to use the carouselle. 


SOCIO-CULTURAL RULES - 
FOSTERING SECURITY 


Finally, the current topic address- 
es an issue, or according to Hymes, 
a norm or standard (Figure 5.14) that 
stood out as equally important to the 
participants of the present study. As 
the least frequent topic, it will simi- 
larly be addressed as one. 


To start with, all of the participants 
claimed using Instant Messaging ap- 
plications regularly throughout the 
whole day. Mostly they used these 
apps for chatting with friends and 
family, some mentioned also contact- 
ing certain services via these apps. 


While using the chatbot in the study, 
the participants clearly calculated 
the choice of which of the platforms 
they would use for that. Two of them, 
P13 and P15, did not expect to connect 
with a specific platform at all and 
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supposed the chatbot to operate as a 

standalone. When there was a request 

to sign in to Messenger, P13 claimed 

that she would close after that and not 

sign in to the platform. Similarly, P5 
stated distrust: 

e “It does feel like a little more of 

a violation of my privacy. Be- 

cause normally I use my chat 

to speak to real people and 

to speak with my friends and 

family, not to speak with busi- 

nesses. I’m not too sure about 

that one. [...| like mentally the 

biggest obstacle is like opening 

it up on like WhatsApp, Mes- 

senger, Slack or something, be- 

cause I feel like these are quite 

private platforms for me... Like 

I don’t feel comfortable with... 

Like having a corporate com- 
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pany or my WhatsApp or like on 
my Messenger. If it was on their 
own website then I would be 
fine with it. But for me, the fact 
that it wants to connect with my 
personal accounts feels like a bit 
of a violation.” (P5) 


What is more, the concern was deep- 
er and she claimed that she would not 
like to share her Facebook details with 
those chats. P3 pointed out data leak- 
ing, similarly P5 believed the chatbot 
to keep the information and sell it 
to someone. They both claimed that 
they always think twice when sharing 
their personal details and try to keep 
it to themselves as much as possible. 
Likewise, P14 was worried if the data 
would leak somewhere. P6 was con- 
fused how the chatbot automatically 
knew his email 

when he was 

asking for price 

alert, but then 

replied himself 

by claiming that Facebook already 
knows everything about him. Another 
participant commented: 

e “Though, I mind the fact that 
its my Facebook’s account 
linked to this bot and I’m not 
sure what history and data it’s 
reading. And I’m just being very 
conscious lately about how dif- 


ferent applications are using my 
data. So I feel like I would have 
gone from a website that is not 
linked to my Facebook account, 
it would have felt more safe 
for me in terms of my data be- 
ing used... [...| I don’t like that 
is through Facebook because I 
don’t know how Facebook is go- 
ing to use that data that I’ve giv- 
en just to them now.” (P4) 


The general distrust against Facebook 
was apparent through the statements 
of many users and most of them 
claimed that they did not use the plat- 
form that much anymore. 


Other than that, the users mostly 
trusted the chatbot itself, since it was 
asserting cooperation with Skyscan- 
ner, a website 
mentioned and 
used by most of 
the participants 
themselves. In 
addition, if the users knew the web- 
sites they were directed to they did 
not express any disappointment. 
However, they were very sceptical 
about the unknown references and 
they often mentioned never hearing 
of these sites before. Similarly, P11 
brought out the factor of not knowing 
the chatbot itself: 


e “[...] its more a question of trust. 
Meaning that if I knew that Eddy 
was already offering me really 
the best of the best. So the an- 
swer was very minimal and very 
narrow. So if it would be like, I 
know that Eddy is always show- 
ing me the best of the best, I 
would say “That's perfect! I’m 
not going to consult any other 
website.”” (P11) 


Similarly, P3 stated that she nev- 
er heard of it and predicted that she 
would use it more when itwas discov- 
erable in social media channels, like 
Instagram. P14 likewise said that the 
initial push was missing, the market- 
ing aspect. Finally, two suggestions to 
make people use the chatbot more, 
were given: 

e “[...| because friends are saying 
that he’s very accountable or 
that everyone is using it... Like 
in general, not just friends. [...| 
about the way he’s designed. So 
maybe increasing the informa- 
tion about how many different 
results have been compared, 
how many other people have 
chosen to go for these three re- 
sults that it is showing me |...]” 
(P11) 
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Despite carrying numerous benefits 
for users, as well as for developers, 
the hype of chatbots has started to 
fade as they have not managed to find 
away into people’s everyday lives. The 
results of the current work illustrate 
agreement and further indicate that 
users either do not use chatbots at all 
and simply avoid them, or use them 
if they really have no other chance. 
Likewise to the findings of Jain et al. 
(2018), the analysis ensures that users 
just do not see any additional value 
to existing solutions and often be- 
lieve themselves to be more skilled 
and trustworthy, since chatbots are 
mostly designed to answer a few basic 
questions. However, as the theoretical 
framework illustrated, it is believed 
that the time of chatbots has not yet 
arrived and technology needs to de- 
velop further and make them smart- 
er. Some of the chatbots, such as Mi- 
crosoft’s Xiaolce, are already rather 
intelligent, however, still fail to de- 
liver expected results. Therefore, the 
current work aimed to look beyond 
technological deficits and focus on 
the pragmatic aspects of the experi- 
ence, thus asking - 


How do users perceive the 
pragmatic shortcomings in 
communication with chatbots? 


To the knowledge of the current work’s 


author, no other study has directly 
addressed pragmatics - for example, 
En and Lan (2012) applied Politeness 
maxims to design the dialogue with a 
robot, and similarly, Hall (2018) sug- 
gested to use Gricean maxims for in- 
teracting with chatbots - yet, thus far 
no one has taken pragmatic theories 
as a base to focus on the existing ex- 
perience and bring out related draw- 
backs. To jump ahead, it is safe to say 
that the shortcomings influencing the 
experience the most are: cooperation 
- how the chatbot and user manage to 
build shared meaning towards mu- 
tual understanding - and ends - how 
users perceive the value, purpose 
and goals of the interaction. Less, yet 
equally important are behavior, con- 
versational style and socio-cultural 
rules. The experience is illustrated in 
Figure 6.1 and will followingly be de- 
scribed in detail. 


To start with, the results indicate that 
before even getting to chatting, users 
are primarily attentive with choosing 
the Instant Messaging platform, since 
they see the chatbot violating their 
privacy as it wants to connect through 
users’ personal messaging channels. 
Other than that, users find it hard 
to understand what the chatbot can 
do and if they should be the ones to 
initiate the conversation. Once they 
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start the conversation and get the 
first message, the connection starts 
to grow and users get engaged, as the 
experience proves to be raising - con- 
versational style is proper, the ques- 
tions are relevant and make sense. 
As the analysis illustrates, however, 
users’ engagement often quickly dis- 
appears, as the options are sent in a 
poor and monotonous list that addi- 
tionally does not support comparison. 
What is more, users are immediately 
pushed out of the chat - acting sim- 
ply as an entry point to another plat- 
form - thus, making users question 
why should they continue to converse 
at all. They get frustrated since the 
chatbot is not proactive, users expect 
it to go in-depth with their problems 
in order to help to find the best fit- 
ting solution - they simply expect it 
to care more. Contrary to that, the 
chatbot rapidly sends more messag- 
es jumping to new topics or back to 
the beginning, therefore handling the 
problem in a superficial matter and 
leaving users feeling that they did not 
get anywhere. Additionally, if the us- 
ers do not answer to these messag- 
es, chatbot disappears unless users 
themselves do not push it to continue 
with the conversation. However, us- 
ers do not write freely to the chatbot 
themselves and rather close the con- 
versation than ask for further expla- 


nations and clarifications. The anal- 
ysis confirms that most of the users 
are left disappointed since the time is 
spent but they need to redo the whole 
process by themselves to dive further 
into various solutions - once again, 
the chatbot has proven to be dull. 


Additionally, as the study demon- 
strates, when the chatbot does not 
understand users’ statements, it of- 
ten misleads them with its utteranc- 
es or makes users think about what 
went wrong, since the chatbot does 
not clarify the misunderstandings. As 
the results show, also the leading sen- 
tences that inform the user how one 
should converse with the chatbot (e.g. 
“Say dates like...”), are actually mis- 
leading. However, users were both for 
and against these - some state that it 
helps to meet their expectations, oth- 
ers find it unnatural. Latter goes also 
for the conversation itself as users 
perceive it being prepared and guid- 
ed, therefore making it feel artificial. 
Coming from that, users claim to not 
read everything since they know that 
the messages are automatic as well 
as notice chatbot’s texts arriving very 
quickly. 


The results show an apparent lack 
of non-verbal cues as well as emo- 
tions. The chatbot behaves properly 


- imitating humans fittingly, not in 
a bizarre way - yet the conversation 
appears flat. Also, chatbot’s level of 
politeness differs among people - 
some see it as respectful, others not; 
some see it as friendly, for others it 
is therefore not professional enough. 
Some also mention the intelligence 
and smartness, whereas others do not 
agree and express opposition. The re- 
sults firmly indicate, though, a lack of 
any connection whatsoever. 


Finally, as the analysis confirms, it 
does not matter if the problem gets 
solved by the bot or an actual human 
being - the experience is successful 
when the problem gets solved and op- 
posite when the problem is left unset- 
tled. However, users are content with 
today’s flows and are not willingly 
adapting to other solutions unless 
there is a clear added value. The web- 
sites are clear, easy to use and visu- 
alise information in a way that allows 
users to compare and edit in a rather 
easy way. Thus, they do not see the 
need to talk to someone about their 
travels and know that they can rely on 
their own capabilities. Further, they 
trust themselves more and would 
cross-check the results anyway. 


It is clear that most of the participants 
are not happy with the outcome and 


would not use the chatbot again, as it 
seems unnecessary. The chatbot fails 
to bring either any additional value or 
even the expected results. Therefore, 
it still feels like a search engine, just 
slightly humanized - instead of click- 
ing to choose the dates, one tells the 
dates. 


Even before the study, cooperation, 
behavior and conversational style 
were expected to appear as themes, 
since these topics were directly ad- 
dressed in the in-depth interviews. 
However, the analysis confirms an 
appearance of two other equally im- 
portant pragmatic topics - ends and 
socio-cultural rules. Coming from 
the results that focused on finding 
an answer to the research question, 
the remaining of the discussion will 
zoom out from the specific problem 
addressing the pragmatics, and will 
reflect the results in the broader envi- 
ronment. Thus, stating two new ques- 
tions and answering them with the 
support of current work’s results as 
well as previous research and theory. 
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HOW TO BETTER 
CHATBOTS? 


INCREASE DISCOVERABILITY 
AND ADD VALUE 


First of all, current work agrees with 
Jain et al. (2018) and Klopfenstein et 
al. (2017) who all agree that discover- 
ability is a great issue. If chatbots, es- 
pecially the ones operating on Instant 
Messaging platforms, want to become 
more used, they first need to be easily 


findable. The current results confirm that in 
order to start using these at all, users have 
to first merely come across chatbots either 
through social media platforms or friends. 


However, the reason why thus far 
chatbots are not widely displayed, 
might be due to the fact that they 
simply do not give any distinct ben- 
efits. Meaning, users get no addi- 
tional value compared to the existing 
familiar solutions and therefore are 
not encouraged to use chatbots, as 
is also stated by Mou and Xu (2017). 
Therefore, similarly to Zumstein 
and Hundertmark (2017) the current 
work states that chatbots have to 
provide additional user-, as well as 
case-based values, such as: “You have 
a 6-hour layover in Frankfurt. The 
business lounge costs 30€, would you 


like to book a place there?” In addi- 
tion, current work’s author proposes 
to discover potential additional 
values by learning about the 
pain points of already existing 
flows that the users are deeply 
acquainted with. 


SUPPORT DATA PRIVACY AND 
ENCOURAGE TRUST 


The research provides a new insight 
into the relationship between chat- 
bots and data privacy. Prior to the 
use of chatbots, it 
must be made very 
clear what data and 
how will it be used. 
Supposedly coming 
from various scandals in the previous 
years, such as Facebook - Cambridge 
Analytica one, users have become 
highly attentive with the trust to- 
wards Facebook and other social me- 
dia platforms. Also, they think deeply 
about which personal details they are 
sharing. The results clearly indicate 
the distrust towards the chatbot and 
especially so as it is violating users’ 
privacy operating on their personal 
platforms. 


It is obvious that using Instant Mes- 
saging platforms gives a great advan- 
tage as the chatbot is able to store the 


previous messages, is easily accessi- 
ble and can learn from the user. How- 
ever, the results agree with Zumstein 
and Hundertmark (2017) that using 
these platforms might not be the best 


idea. Current work proposes 
to allow the user to choose 
if the chatbot accesses one’s 
personal platform or uses a 
more general way, such as the 
website - as was expected by 
users in the current study. 


However, it once again comes back to 
the additional value issue - chatbot 
needs to give information that cannot 
be easily found otherwise or simply 
provide something extra. 


What is more, as the results indicate, 
users have noticed chatbots popping 
up on various websites, yet avoid 
them. Therefore, chatbot’s design has 
to provoke conversation and various 
alternatives have to be tested to un- 
derstand how users trust the chatbot 
the most. An example to draw upon 
- after redesigning their chatbot into 
a full-screen conversation, Landbot 
website’s conversion rate grew five 
times (Lomas 2018). 


BE INITIATIVE AND EXAMINE 
THOROUGHLY 

Once starting to use the chatbot, the 
results indicate that users expect it 
to initiate the conversation and as 
the interaction advances, there is a 
clear need for follow-up questions. 
The analysis shows that users want 
the chatbot to go in depth with their 
problems, therefore narrowing the fi- 
nal outcome such that it corresponds 
directly to users’ needs. Itis important 
to note that it has to be done in a way 
that users do not feel overwhelmed 
by the amount of questions. Howev- 
er, the results of the study show that 
users never mention the extensive 
amount of questions and do not mind 
answering to the chatbot, yet avoid 
asking further questions themselves. 
Similarly, Bernsen et al. (1995) ac- 
knowledge that system-directed di- 
alogue fails if users themselves have 
to start asking questions - therefore, 
the system should be designed in a 
way that users do not need to ask for 
answers themselves. 


What is more, the experiment brings 
new insight in terms of leading sen- 
tences (e.g. “Say dates like...”). Despite 
the need to guide the interaction, it 
is arguable if the leading sentences 
either work for or against their ini- 
tial goal. The results show that these 
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sentences create misunderstandings 
at some instances and users perceive 
them unnatural. As mentioned, users 
avoid typing to the chatbot unless it 
is to answer a question. Leading sen- 
tences can be seen as one reason for 
that - if the leading sentence is miss- 
ing, users do not know what to say as 
their expectations have been lowered 
by showing that the chatbot only un- 
derstands specific sentences. On the 
other hand, users mention that with 
leading messages their expectations 
are managed and they understand 
better the chatbot’s capabilities. The 


use of the leading cues has to be consistent, 


however, the current work 


suggestions as unnatural and misguiding, 
thus would recommend to ban the use. 


When it comes to handling errors, 
current results show that users are 
mostly trying to get over misun- 
derstandings themselves - they are 
forced to think about what went 
wrong. However, it is believed and 
some also state doing it for interview 
purposes, therefore if they encoun- 
ter these situations in actual circum- 
stances, they would probably close the 
chatbot right away. Thus, as the user 
is mistaken or chatbot cannot under- 
stand what is meant, it should not give 
a general error message, such as an- 
swering: “I could not find in airports 


around there. Try different city,” after 
the user types “Milano”. The chatbot 
could either work like Google, for ex- 
ample, and ask: “Did you mean Mi- 
lan?” or in the worst case admit that 
it does not understand and ask to 
rephrase. But it should definitely not 
lead the user to a totally wrong direc- 
tion, making one think that there are 
either no direct flights and therefore 
change to “Rome”, or that they should 
be more precise and say “Bergamo” 
instead, as happened in the current 
study. Moreover, if the chatbot does 
not know what the user means (e.g. by 
“good weekend”), 
sees such it should not guess 
what has been tried 
to say - once again, 
the follow-up 
questions should direct the conversa- 
tion back on the right track. 


MATCH THE BEHAVIOR 
AND CONNECT THROUGH 
EMOTIONS 


Finally, it is evident that the person- 
ality traits differ among people, ones 
perceive the chatbot as polite, for 
others it is not professional enough. 
Some see the casual conversation- 
al style fitting, others disagree thor- 
oughly. As Nass and Reeves (1996) 
stated, people like computers with 


similar personalities, thus it is seen as 
a proper explanation here too. 


Everyone agrees, though, that over- 
all conversation appears flat, with no 
emotions as well as no connection. 
Lee et al. (2017) propose to use per- 
sonal information, such as age and 
gender, to improve personalized re- 
sponse generation method for classi- 
fication and recognition of emotions. 
More towards future scenario, once 
the technology develops further, the 
chatbot has to become smart enough 
to provide even more personal expe- 
riences, since the current study did 
not see any specific patterns in terms 
of age and gender. However, a more 
thorough study is needed. In future, 
perhaps affective computing could 
be one way to understand which be- 
havior and conversational style is ex- 
pected at the given moment. Yet, as 
mentioned, users are highly attentive 
with sharing personal data, therefore 
it needs to be further discovered how 
would they react to affective comput- 
ing and the usage of data that is need- 
ed for that. 


However, more applicable 
today, coming from the main 
target of the chatbot, some 
sentences to foster emotions 
need to be added. Such as, 


“Nice choice! Barcelona is 
amazing at that time of the 
year.” Jain et al. (2018) and Thies 
et al. (2017) suggest to enrich the con- 
versation with humor, however, cur- 
rent results disagree. Perhaps coming 
from the seriousness of the field the 
used chatbot is operating in, booking 
plane tickets. 


It is evident that the chatbot should 
understand users to provide the best 
experience and build connection. To- 
day, perhaps it could be done through 
sentences the user writes as well as 
through additional data, such as age 
and gender, as proposed by Lee et al. 
(2017). It must be understood which 
approach suits the user the most at 
the given moment - more casual or 
more professional, more friendly or 
more polite. Users are different and 
“one size” does not “fit all”. 
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ARE CHATBOTS WORTH 
BETTERING? 


Thus far the discussion has focused 
on providing valuable practical im- 
plications for the community to com- 
bine or enhance the chatbot on one’s 
online platform. However, as a final 
thought, the research questions the 
necessity of these conversational in- 
terfaces in general and asks if they 
will ever be good enough to provide a 
useful alternative to the existing solu- 
tions. 


First, perhaps there is a reason why 
people do not use many offline ser- 
vices anymore (such as travel agen- 
cies) and prefer to take care of every- 
day matters online and by themselves. 
As the results ensure, participants do 
not need nor want to talk about book- 
ing flight tickets or hotels - they are 
happy to take care of the instances 
themselves as it is quick and familiar. 
However, as the offline services still 
exist, it means there is still a demand. 
Therefore, perhaps chatbots should 
be aimed for a very specific target. For 
example, less tech-savvy users could 
benefit from the use of chatbots, since 
they do not feel comfortable using 
regular websites and find these sites 
difficult to understand. 


Similarly, when Graphical User Inter- 
faces first came, they worked slower 
than Command Line Interfaces for the 
expert users and even today, many de- 
velopers and other professionals still 
make use of the efficiency and utility 
of giving commands to the computer. 
Today’s casual users are already good 
and efficient enough with GUIs and 
work their way around various web- 
sites rather quickly, thus they might 
not be the suitable target. Therefore, 
as the first milestone, chatbots should 
first aim to fulfill the needs of the us- 
ers who find GUIs difficult to use and 
then move on to satisfy more complex 
needs of tech-savvy users. 


However, as one participant in the 
study brought out, elderly, for exam- 
ple, might benefit more from speech- 
based conversational interfaces, such 
as virtual assistants like Siri, as it 
proves to be quick and clear. There 
is no need to type on a small screen 
or read the tiny text. As it was for the 
70-year-old French man, he trusted 
the first answer the virtual assistant 
gave and had no problem talking to it 
in front of other people. Whereas the 
participants of the study, who repre- 
sent mostly young millennials, firmly 
claim that they do not feel comfort- 
able using such agents in public and, 
additionally, these interfaces most- 


ly do not correspond to their com- 
plex needs. Thus, they rarely use Siri 
or Google Assistant for simple tasks, 
such as asking it to call someone, look 
for the meaning of a word or the name 
of a song, simply goof around and try 
it out. 


As stated, it is obvious that most of to- 
day’s websites or applications provide 
a rather satisfying user experience 
- or at least a couple of ones that are 
favored by users - and unless there is 
a clear additional value, users do not 
see the need to use yet another new 
way. Even more so, results indicate 
that they do not mind surfing the web 
- might be that it gives them the feel- 
ing of being in control. What is more, 
opposing to Jain et al. (2018) who stat- 
ed that users were 

dissatisfied when the 

chatbot passed on the 

control to an external 

interface, the results of the current 
work illustrate that users felt relief 
arriving to an already familiar envi- 
ronment, the websites. That might 
have occurred due to the complexity 
of the field, searching for flight tick- 
ets. Perhaps designers should focus 
on advancing the already existing 
alternatives - making websites and 
applications more “conversational” 
by adding storytelling characteris- 


tics and making flows easily under- 
standable. Also, as can be seen over 
the development of the Web, the in- 
formation has become immense and 
therefore the services provided de- 
pend on personal searches or in- 
terests. The approach continues to 
evolve and possibly could be done 
within existing solutions and there is 
no need for a chat interface to provide 
these personal results. 


Current work agrees with Klopfen- 
stein et al. (2017) and argues that per- 
haps not all services are even suitable 
to be displayed via chatbots, as some 
simply need to deliver lots of infor- 
mation and additionally have to fos- 
ter comparison. Otherwise, if only 
one final result is displayed, it needs 

to fit the user com- 

pletely, coming from 

the adjustments and 

indicated variables. 
Overall, the user has to be able to 
trust the system fully. However, as the 
results indicate, users always doubt 
and feel that if someone is providing 
them something, it is influenced by 
other hidden variables, as one par- 
ticipant brought out. For example, if 
the user visits a retail store, there are 
two options to either ask for help or 
look oneself - if one decides to ask for 
help, s/he might feel that the options 
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are influenced by other metrics (e.g. 
the shop wants to get rid of last sea- 
son’s collection). The final decision 
comes down to time as well as capital 
and the same goes for chatbots. The 
study confirms that one trigger for 
the user could be time as well as price 
insensitivity. However, today’s casu- 
al user adapts well to new websites 
and is therefore already rather quick. 
Also, user trusts oneself with current 
technologies a lot and would cross- 
check the provided solutions anyway. 


The study agrees with Shum etal. (2018) 
stating that it will be incredibly chal- 
lenging to design a chatbot that can 
fully understand users and the sur- 
rounding contextto serve their specific 
needs. Therefore, 


experience even worse. 


Therefore, perhaps the existing solu- 
tions should be advanced to support 
different users in finding important 
information fast and in a visually ap- 
pealing way. Once the user’s expec- 
tations are fulfilled in a familiar way, 
perhaps one is ready to make inno- 


vation and design a fully functional 
chatbot. 


LIMITATIONS 


The study portrays a very beginning 
in understanding chatbot’s user ex- 
perience through different pragmatic 
theories. Therefore, not all pragmat- 
ic approaches were included and the 
research addressed only some of the 
philosophies of the field. The work 
aimed to cover different theories, yet 
not go too broad as the goal was a 
profound research on one topic, rath- 
er than the entire field. 


before starting to 
implement chatbot to online platforms, 
one should reconsider if the service is 
suitable and if there is a real need or 
simply a desire to implement innovation - 
the new solutions that are still working in 
an insufficient manner, make the overall 


The study is limited to 
show results only for a 
small sample size, who 
are mostly millennials 
and rather frequent 
technology users - 
thus, the results are 
not generalizable for 
all age groups as well as all technology 
competencies. Also, a larger number 
of participants is needed to identify 
more expansive trends. However, due 
to the use of heterogeneous sampling 
method, it is believed that the results 
can be used to illustrate similar us- 


ers - at least within European region, 
similar age and technology compe- 
tencies. 


What is more, since the field is con- 
tinually evolving, as can be illustrated 
by the fact that many of the chatbots 
disappeared within the time of re- 
search (from April to November 2019). 
Thus, the study reflects the state of 
the field at the time of the study, in 
autumn 2019. 


Seen as one of the biggest limitations, 
the study used one existing solution 
operating on various Instant Mes- 
saging platforms. Thus, the results 
might have differed in the use of an- 
other chatbot. However, the choice 
was made carefully: its high ranking 
in botlist.co proved that the design- 
ers have done an overall decent job; 
the field of application is productiv- 
ity-driven, as is the trend of use of 
chatbots. Moreover, as the task was 
rather open, to foster exploration and 
not influence the experience in any 
way, not all users went through the 
same flow. Yet, as the chatbot is not 
yet very eventful, mostly all of them 
encountered the same instances as 
well as functions. Therefore, it is be- 
lieved that the recommendations 
could apply to chatbots’ design more 
generally. 


6_ DISCUSSION 


SVL 39Vd 


, Conclus_ 
` Jom 


Ever since the second batch of aliens, 
aka computers, “landed” on planet 
Earth and started to invade the house- 
holds, humans have tried to com- 
municate with them - first through 
commands, later via graphical inter- 
faces. The recent trends, however, 
are pushing to find a way to converse 
with computers in natural language, 
through Conversational User Inter- 
faces, such as chatbots. To facilitate 
this movement, the current research 
aimed to find out how users perceive 
pragmatic shortcomings in commu- 
nication with chatbots. 


Based on qualitative thematic analysis 


a chatbot, opposing to all human-hu- 
man communication. Additionally, 
the level of friendliness and other 
behavioral characteristics varied a 
lot from participant to participant. 
Fourth, conversational style - users 
do not distinguish any emotions. They 
see the use of emojis, but perceive 
the language as normal Internet lan- 
guage. Therefore, the chatbot appears 
as a regular search engine, yet slightly 
humanized. Last, but not least, are so- 
cio-cultural rules. Meaning, in today’s 
state of affairs where data is changed 
or sold, users value their privacy and 
appear highly attentive in trusting the 
chatbot and the plat- 
forms it works on. 


of 15 in-depth interviews, five pragmatic 


themes clearly stood out. The results 
indicate that the first and most evidential 
one is cooperation - users simply expect the 
the chatbot to care more and go deep 
with their problems, not give superficial 


answers. Therefore, it should ask 
more, not jump to new topics or back 
to the beginning. Following, ends is 
another important matter - users 
expect the chatbot to give additional 
value, not do the same things that the 
users themselves can do. It explains 
the willingness for adopting chatbots 
and users’ mental models. The third 
pragmatic aspect is behavior — users 
do not perceive any connection with 


Current work ad- 
dressed the topic in 
perspective of 
pragmatics since it is 
important groundsel 
in human-human communication, 
helping to understand what is really 
meant by what has been said. Also, it 
can be seen as one of the character- 
istics that helped humankind to out- 
grow the alien status over millions of 
years. What is more, to the knowledge 
of the current work’s author, no other 
study thus far directly applied prag- 
matics in investigating the user ex- 


perience of chatbots. Thus, various 
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founding pragmatic theories were 
researched and then employed in fa- 
cilitating the in-depth interviews to 
understand if pragmatic variables af- 
fect the experience. If not, there is no 
need to spend resources on advancing 
these aspects of communication and 
developers can continue to advance 
Artificial Intelligence, Natural Lan- 
guage Processing and other crucial 
technologies. However, as illustrated, 
several pragmatic shortcomings were 
identified. 


Coming from the results that intend- 
ed to provide an answer to the main 
research question, the research even- 
tually zoomed out from the specific 
problem focusing on pragmatics and 
addressed the results in the broader 
environment. 


Therefore, with the assurance of pre- 
vious research as well as the results 
of the current study, the research 
aims to contribute in improving the 
user experience in the field of chat- 
bots - several suggestions were made 
to advance the design of chatbots. It 
is necessary to increase both, the dis- 
coverability as well as the added value 
— users have to have easy access and 
high motivation to use these tools. 
Data privacy has to be addressed - 
users should know precisely what 


data and why will be gathered. A 
chatbot needs to put more effort into 
personal approach - users must feel 
that the solutions are corresponding 
to one’s needs and are not general 
ones, thus further questions, as well 
as feedback, must be inquired. What 
is more, if errors encounter, again 
chatbot has to deal with it, not just 
give a general answer pushing the 
user further from the real problem 
and causing an even bigger frustra- 
tion. It has to help the user, for exam- 
ple as Google does with its: “Did you 
mean...?”. Finally, the overall attitude 
has to foster mutual connection, such 
as in human-human communication. 
Thus, the conversation cannot appear 
flat and should, for example, include 
emotions through the messages the 
chatbot sends - not only emojis but 
rather with utterances, such as: “Nice 
choice! Barcelona is amazing at that 
time of the year.” Ideally, the chatbot 
should change the level of politeness, 
friendliness and other characteris- 
tics, according to the user, since the 
results show a clear disparity in the 
issue. 


Having proposed the aforementioned 
growth opportunities, another rather 
opposing thought stood out from the 
results. Namely, the results indicate a 
strong distrust against chatbots and 


Having proposed the 
aforementioned growth 
opportunities, another 
rather opposing thought 
stood out from the 
results. Namely, the 
results indicate a strong 
distrust against chatbots 
and not only in the 
matter of results but in 
the overall practicality. 
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not only in the matter of results but 
in the overall practicality. Perhaps 
chatbots will not be the next main in- 
terfaces and will not substitute apps 
on smartphones, as Mark Zuckerberg 
predicted. Perhaps not all services are 
even suited to be displayed in such a 
narrow context. Or perhaps users 
have become skilled at using mod- 
ern technology and they do not need 
to talk to anybody, being it either a 
computer or a human being, when 
going through familiar flows. Perhaps 
chatbots should focus on fulfilling the 
needs of a very specific target group 
and enhance the lives of less tech-sav- 
vy people who do not feel comfortable 
using regular websites and find these 
sites difficult to understand. Howev- 
er, maybe other CUIs, such as virtual 
assistants, are already a better solu- 
tion and fit the needs of this target. 


Computers are far from reaching the 
status where they are no longer bi- 
zarre aliens, however, taking the fact 
that human beings took millions of 
vears to develop a well-working sys- 
tem to communicate in natural lan- 
guage in a meaningful way, it is only 
normal as computers have not been 
around even for a century. Even more 
so, as shown in the very beginning 
of the work, writing has existed for a 
very limited time compared to speak- 


ing and drawing, thus writing with 
computers might follow the same 
evolution. 


The current work aimed to give a 
contribution to this science-fiction 
scenario by taking inspiration from 
human-human communication and 
therefore studying the pragmatic as- 
pects of human-chatbot interaction. 
However, only time will tell if these 
aliens are worth talking to via chat- 
bots - it is all dependent on people, 
the creators of these bizarre aliens. 
It depends whether the openness, 
needs and expectations of users will 
force science and technology to look 
towards chatbots. It depends whether 
organisations, designers and devel- 
opers will advance the solutions such 
that users will have the motivation to 
look towards chatbots. 


FUTURE RESEARCH 


Based on these conclusions, future 
research should apply the proposed 
suggestions and consecutively study 
the outcome in a similar matter to al- 
low comparison and understanding if 
the suggestions are as relevant as they 
appeared to be in the current analy- 
sis. Therefore, future research should 
further analyse if bringing additional 
value, for example, would make users 
appreciate chatbots more as an alter- 
native to the already existing solu- 
tions and the information they carry 
or would they still rely on their own 
competencies. 


Moreover, a very interesting next 
step would be to understand how 
the experience and the pragmatic 
aspects are perceived by users who 
are not that technologically compe- 
tent. Therefore, older people could be 
seen as perfect participants for future 
studies. 


Another research could focus on 
studying the differences in the char- 
acteristics of behavior and conversa- 
tional-style. As the study confirmed, 
users perceived these characteristics, 
such as politeness and casual talk, in 


a different way. It would be interest- 
ing to see, if these characters match 
to the user’s ones, perhaps the expe- 
rience could be better as well. 


Also, despite thorough research, the 
author had no previous knowledge 
in the field of pragmatics. To better 
understand the implications of these 
results, future studies could benefit 
from the deep knowledge of linguis- 
tic experts — both, for pre-, as well as 
post-study phases - for development 
and analysis. Additionally, other ap- 
proaches and theories of the prag- 
matic filed could be included. 


Another aspect that has not received 
much attention, is the final thought of 
the research - whether chatbots are 
useful at all. Distinct research could 
investigate the issue and understand 
if there is an actual need for them 
or more advanced technologies have 
banned the use of chatbots. Not even 
smartphone-based virtual assistants, 
but Al-based avatars, next-genera- 
tion chatbots — for example, Soul Ma- 
chines™ allows to create Digital Hu- 
mans and converse with them. 
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, Appendic_ 
Mes 


A1_ INTERVIEW GUIDE 


Warm-up session_ Questions to get the conversation going in the mindset of 
the topic: 

e Can you tell me your name, age, and your occupation? 

e If you travel abroad, how do you usually plan it - look for flights etc? 
Have you experienced any pain-points throughout the process? If yes, 
could you give me an example? 

e a. Describe your relationship with technology. 

a.1 Do you follow tech-news etc? 
b. How much do you use technology on a daily basis? What are the main 
applications and websites that you use? 
b.1 If the interviewee does not mention instant messaging ap- 
plications: What about instant messaging applications? 
b.2 Which ones do you use? 

e Do you know about conversational agents, such as Siri or Google assis- 
tant? If so, how often do you use them? Tell me about the last time you... 

e What about chatbots with what it is possible to chat using text? Have 
you used them? If so, which ones and how has your experience been? 

e Where do you notice the chatbots the most? 


Task session_ 

You want to search for flight tickets for your upcoming trip. You heard from a 
friend about a chatbot called “Eddy Travels” and decided to give it a try. 

The participant is observed while doing so. Also they do not get stopped after 
achieving the goal to allow exploration. 


Topic specific session_ Questions concerning pragmatics: as presented in 
the body of the work, in the chapter concerning methodology. 


Cool down session_ Questions concerning the overall experience: 
Would you say that you came to the mutual understanding or that the com- 
munication failed? Why? If failed, at what point? 
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How would you describe negotiation in this case? 

What do you think of this chatbot? Would you use it again? 

What might keep people from using it? 

How would you describe the situation in real life? Does it remind you to 
something? 


A2_ INTERVIEW TRANSCRIPTION 


All of the transcriptions can be found in the following folder: 
https://drive.google.com/drive/folders/19eAAjfnvgoFIXNh_QAjxcHx- 
BrJZ64M8z?usp=sharing 


